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f F i nal Report 

NIE Grant G-79-0133 

Composition and Comprehension of Simple Text^ 

■ ^ * * Gary fl. 01 son - * ' 

Univer%ity of Michigan 

P,r inc i pal I nvesti gator 

* 

This report describes the research carried out under NIE grant 
G~79~0133* dur ' n 9 the period from September, 15* 1979 to September 15' 
1982. The first, part reviews the overall gdals and theoretical 
perspectives of the" project. The second section describes a series of 
studies carried out during the project. The third part' lists the talks 
and papers that have resulted from the project. 

BACKGROUND * 

This program of research* focussed on the comprehension and 
composition of simple texts* The tasks of composing text or j 
understanding it are each exceedingly complex. The present research 
assumed that an adequate character i zat i on of either activity requires 
that -we consider the nature of the relation between the reader and the 
writer. Thus, we were interested in examining the reader's assumption* 
about how a text is written and how this affected comprehension. 
Similarly, we wanted to learn about how v writers take account of their, 
readers as they wr 1 te *or revise their text. 

The primary features of the conceptualization that has motivated^ 
our research appears in Olson. Duffy and hack (1980) and Olson, fl£tk and 
Duffy ( 1 981) . Rather than dup I i cate these d i scuss i ons here > we will . 
present a brief summary of the central points. The core idea was 
described in the preceding paragraph: the writer and reader communicate 
through a text according to a set of conventions about- how a text ought 
to work. Such conventions govern all forms of social interaction, 
including all the different ways in which language is used w We have 
been particularly interested in those Conventions of written * \ 
communication that ariose because of the special characteristics of 
wr i t i ng when contrasted with speech . Tabl e It f rom 0J son et 3! . * (1 981) » 
shows the major differences between speaking and writing/ . ' 

y "* 4 ' * 

On the basis of these differences* there are a number of 

conventions that regulate t!Se process of written comtnuni cat i pn * Table 

2/ a I so from 01 son et a I . (198O t shows some of these. These pr i nc i pi es 

apply to simple -texts, such as the stories and essa\& that have been 

used I "W our research. By and large these pr i nc i pi es are self*-* - 

explanatory, but further discussion of them is presented in Olson et 

al . (1981) J 
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Tabic 1 

ChajacjctiMitrs of ujiiinf amipjjcd u> sptech. 



> Chaiacicjistir t , 
1, Permanence 
2 Detachment * 



3. Absrrut of fttdfoack 

4. Noii$prcif»cit> \ t 

6 Ol^dNl/cititkJt* 

h f tontimj 

9. Cn jui p rVi 4 j\hii+ and deijii) 

1 tK OitaUr t i^j 1rvjl\ and 

al^UoCtn- ^ of Vubjeti roller 



Pttujf lion 



Writing p<r*isf s thiouph time, while speech is highly 
transient* 

Bulb the conttnl and form of ferftlen fonpuage is 
Voiced fiom ihc immediait com ex t in space 
*nd time, 

Uritin^ is b onV*a> process. *itftout feedback. 
Wjjlinf is itpicall} addressed to a pciiml audience 

id the j than a specific individual. 
The topic bf the te>l deserves to hate the trouble 

taken to write jt up. 
Wrjlfrnjanpuafe much more panned and dtpa- 

nirecf than speech* V 
The lan£Uii£c of willing tends to bi- mort 'formal 

thar speech. 

Uriticn lanr uae<^atle*» redundamy than spoken 
t*i nrilape. 

U jilttT, bnf u^jtt cafi devrlop a topii in £rta!eJ 
UYitkr, l^n^uj^t can develop rtuwc crmple* idea** 



i 

These pr i nc i pies gu i de the act i v i t i es - of both" the. wr i ter apd the 
reader/ In most of the work carried Out under this grant, we have 
studied ^he strategies of readers, using a th i nk i ng-put- 1 oud methodology 
(see Olson, Duffy and Mack, IQStf, f>or a detailed discussion) to reveal 
exactly how readers go about .extract i ng th,e meaning of a text, using 
these principles as guidance. In a study carried out during the las*t 
year of the grant we examined the" activities of writers, studying how 
texts written to convey a particular content were assembled and later 
revised. The findings of these investigations will be summarized in the 
f ol 1 owi ng sect i ons . , ' 



RESEARCH 



The collection of empirical data\on comprehension and composition 
was the central focus of activity during this grant. Because ot the 
scope and complexity of the data collected, not all analyses and write" 
*ups .have been completed* In each part of this section,, a general 
overview will be- given of the type of data that was collected and the 
rationale fr>r the work. Where detailed analyses hay^been completed, a 
summary, wi ll be presented and publications or tat£s that have resulted 
will 'be 1 i sted . Each subsect i on will cone 1 ude with a d i scuss i on of the 
plans for further analysis and publication of .the data we have on hand. 

f 

^ As .planned, the bulk of the research compSfcfcted during this grant 
1 was on comprehension. However, during the third year of the project we 
began work on composition that grew out of our previous work on 
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Table 2 • 

Conventions of composition for simple 



texts. 



Convention - - 

1. Purpose J 

2. Balance or novel and familiar 
elements' 0 

A. Familiarity * 

B. Novelty 

3. Underlying organization 

A, Focus 

B, Overall plan ■ 

<i>Coherence^ ^ 

(u) Completeness^ 
C + Conventional world 

4. Surface organization 

A. OronisJience ' 

B. Audrenee * 

C. Scaffolding 



D. Segmentation 

E. Connectivity 



"F. Economy 

G Orderly flow 

H. Langujgc 

(i) Signally * 

<u) Le^el 
J. Genr*.*-ipoeific conventions 



Description ' * 

■ - '■- - / 

Th*j writer has one or more specific purposes in mind. 
' The text contains a' bah net or familiar and novel 

elements. * s " ' ■ 

The text rriakes contact with things thefreader know* 

about ^ 
The text contains new or distinctive elements. 
The text is based on an underlying structure that is 

appropriate and wclJ -formed forVhe particular 

genre. 

There is one mailf line of development 
There is ary^vetaU plan that provides a well-formed 

orgam/ation for the propositions of the text, 
Each individual propo*i*ion fits in a well-ordered 

way into the general plan. * ^ 

The overall organisation has a elosed *>r optimal 

structure. + 
The text is based on a world that is similar but not 

identical to the real world. ^ 
The writer has a surfed pbn Tor presenting the 

surface proposition* of th< texL " ( 

At any point in the te\i the writer kno*s where it* 

is going. 

% The text is written with an auditneein mind. 1 

The writer presents en^it^h "supporting materiX in 

* % the text so that the reader ha* sufficient back- 
ground to be able to reconstruct propositions 
where necessary, * 

The Jext is organised into surf^ee chunks. 

TheVriier provides sufficient textual information so 
4 that the leader can rridke all th^ necessary inferen- 
tial connections among the elements^ the text. 

Everything that is prevented has a purpose within the 
surface plan. * * ; 

The "Sequence of segments and propositions in the t 
*urface.of the text ^principled. ' , 

There ate eonsentions for the tarface language of 
each genre. 

Appropriate surface signals will be used to mtrk 

" Transitions, ere- 
Appropriate levels of iangujge will be used 
, In addition to the general conventions listed above 
particular gerues will often have specific te\t con- 
ventions governing the surface form. 
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comprehension* The specific research carried oui is described in the 
next two sections* ^ 
^ ■ * r 



STUDIES OF COhFREHEnSlON 

"■ : r— t 



I. ANALYSIS AND EXTENS ION OF PR1J3R.T0L DATA 

Prior to submitting the proposal which led to funding of this 
project we had collected th i nk i ng-out- 1 oud data for four stories. The 
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focus of this work was the question: What i*s a reader doing while 
reading a simple story? * To get ideas* we had a number of subjects think 
out loud as they read simple stories. Since'tnany details of the , 
methodology have been discussed in Olson', Duffy And Mack 098M and many- 
of the major findings have been presentelh-4A^plson, Mack, and Duffy 
0981) * only the highlights of the results of this, work wi 1 I be 
presented here prior' to describing what additional worK we have done. 

The thinking-dut-loud data provided two kinds of information about 
the processing of simp-Je stories. Analysis of the general content of 
the protocols allowed us to construct a general picture of how an 
intelligent reader approaches the,task*of reading a story** As described 
in Olson* Duffy and Hatk (1380) and -tfte two other papers j lis t cited* 
readers of stories engage in large amounts of predictive* problem- 
^solving behavior as they read through a story. They possess a large 
amount of general world knowledge and spec i f story knowledge that they 
apply in a predictive fashion as they read through the text, 

A' central question posed in our proposal is the extent to which 
th i^s ,por tra i t of story understanding actual ly holds for readers who are 
nq£ thinking out loud and for texts other than stories, A variety of 
approaches were used to address this question. One was to look at the 
r el at i onshi p between th i nk i ng-out- loud data and other measures of , 
processing, such as reading time* Multiple regression analyses of 
reading time datfe, reported in Olson, Mack $nd Duffy 0980; showejd that 
for wel I -f drmed stor ies there was a *rel at ionsh i p» with s i 1 ent readers 
reading more slowly at £he same places wheYe tb i nk i ng-^out** loud readers^ 
talked more (with the obvious confoundfng effect of sentence length 
control led) 1 This finding has been central to much of our subsequent / 
work,- and has justified for us the value of thi nk i ng-out- loud data for 
the study of comprehension (see a detailed discussion of the pros and 
cons of. this method in Olson, Duffy and Mack, 198*1} . A second approach 
was to jfollect a comparable set of'data for a genre other than simple 
stories* This work is described in section 2* A third approach was to" 
collect new protocol, data for s'toVles and essays, using more focussed* 
anal yti c tasks , This is described^in section 3* Finally, several 
experimental studies of specific predictions that Emerged from this view, 
of comprehension were pursued, the best example being Duffy's 
dissertation research, described in section 5, 

We recognized that tJhe original set of th i nk i ng^out- 1 oud data we 
had collected were exceedingly rich* and so during the course of this 
project we have devoted some of our energies toward their further t 
analysis. In particular, we wanted to get a deeper , richer picture of 
exactly what these readers were doing, f To' this end, we developed a - 
scheme for coding the content of these protocols, and have completely 
coded the protocols for one of our four stories, Lent i 1 , 

The coding scheme is based on a simple principle. Each utterance 
in a" thi nk i ng-out- loud protocol says something about some part of the\ ' 
text. Thus, two features are coded for each protocol segment: that part 
of the text that is referred to, and what was .said about it.. The first 
of these we refer to as an Attention code, the second as an Operation 
code, ' The coding scheme is shown in detail in Appendix A. y 
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Considerable time was devoted to developing and refining this 
scheme* and establishing its reliability. We required that two trained 
scorers agree on their codings at least 80% of the time. For purposes 
of final coding* the disagreements were resolved by discussion between 
the coders. The original th i nk i ng-out- loud data collected for 12 
subjects for the story Lenti 1 (see Olson et al.i 198l) have been 
completely coded and checked* and a series of analyses of these data are 
planned but not yet completed. 

This work is still incomplete. It is time-consuming work, and 
unt i 1 we are< convi need it is suf f 1 c rent ly useful » 'we do not want to code 
the rest of our protocols* We plan to complete our analysis of the 
Lent r 1 data and then make a decision about the treatment of the 
remainder of this rich data base. " 

2. TOL ANO READING Tl HE OATA FOR ESSAYS x 

* 

An early concern of ours was' the representativeness of our findings 
with stories. Would a similar picture ©f comprehension emerge for other 
text genres? Early in this project we collected th i nk i ng-out* loud» 
reading time, and recall data for academic essays. We selected four 
essays, and for each one we had two versions. The portrait of 
processing we found Snd the detailed quantitative analyses of these data 
were xiuute different than what we founcf with stories. A$ summarized in i 
Olson, Hack and Duffy (1981) , while the reader of a story approaches the 
text in a predictive, ' prospect i ve fashion, focussing on what i^s' coming 
up, the readers of our essays approached their *texts in a retrospective 
fashion, fitting in what they were currently reading with what had come 
before but making only the jpost general* vague predictions abcrtjt what 
they wer6 going to^be reading (and. making these largely because we asked 
them to) . Further* unlike the stories* we found no relationship between 
the TOL data and si I ent read i ng t i mes . The detal 1 s of much of th i £ work 
appeared in Olson, Hack and Ouffy O98I) . ' 

There are additional details of these data that still need to be 
examined. Ouffy* Olson* Hacki Vincent and Eaton (1982) reported some 
analyses of reader's strategies while reading essays* and the$e analyses 
will be expanded and then reported in a new paper. We also want to 
explore the usefulness of a scheme like that shown in Appendix applfed 
to essays. 

V 

3- NEW CfATA Ttm STORIES ANO ESSAYS .. .. 

The general TOL data we collected for stories and essays (just 
reviewed in sections I and 2) revealed to us a number of further 
question^ that we decided to pursue with more focussed TOL tasks (see a 
discussion of the rationale for the different types of TOL tasks in 
Olsoni ijuffy £ Hack, I98M , One foctfs was pfedict ions. Sifice our stor^ 
TOL data had shown a clear indication of the central role of predictions 
in story processing, and we had found such a marked contrast between 
stories and essays in thi^ we collected new TOL data in which we had 
subjects only give predictions after reading each*sentence. Another 
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interest stimulated by our previous T0Lf"data was on questions asked by 
subjects as they were reading. This in turn led us to collect data in 
which subjects asked questions following each sentence of a story or an 
essay. Of the four types of new data collected (story/essay crossed 
with prediction/question), only the quest i on-ask i ng data for stories 
have been analyzed sufficiently to present the findings* 

Question-Asking for Si mp le Stories * |n its primary mode of use, a 
question is a device for seeking new information that is to be related 
to an existing knowledge structure. When to ask ^ question* and exactly 
what to ask, are both symptomatic of the status of the knowledge 
structure at issue, as well as, no doubt, the general intelligence of 
the asker. We have all encountered the person (often ourselves!) who 
indicated they did not know enough about a topic to d^k a question about 
it* Thus, intuitively, there is a 'link between -one' s knowledge or 
understanding of a topic and the ability to ask a question about it 
(e*g., see Miyake 6 Norman.* 1979)* * 

There is another connec tion^ between questions and comprehens ion. 
Educators and researchers have long suspected that approaching the 
comprehension of text w4th either general or specific questions in mind 
might facilitate understanding* There is 4 sizable research literature 
on this role of questions ^"understanding text (e»g*, Anderson & 
Biddle, ^S^Frase, 1975)* Questions of tfrvis type focus the reader's, 
attention on exactly those pieces of information that are important to 
understanding what the text is about* Since one of the problems faced 
by the reader is selecting the most relevant or important information 
from a t;ext, appropriate questions can serve as a guide for this 
i mportant process * - 

These two uses of questions in relation to understanding hav« an 
important relationship* Questions asked about a text are bath an 
indication of having understood what has b^ei; read and a guide to the 
further understanding of what is about to be read* This suggested to us 
that questions asked by a reader while reading a text might be an 
especially informative kind of data for monitoring the reader's 
understanding of the text* * ■ • 

In our earlier work (01 soft, Duffy & Mack, 1980, 1984; Olson, Mack & 
Duffy* 1981),. one of the things we noticed subjects doing while thinking 
out loud during riding was asking questions* The kinds of Questions 
people asked and lijie places they asked them seemed to us indicative o^ 
important comprehension processes: This led us to conduct a specific 
study on the relationship between on-line question asking an$ 
comprehension. We shall report a few h igh 1 i ghts ^of this study here* A 
more/xoi^lete report of it will appear in Olsoh, Duffy** Eaton* Vincent 
and Mack {in preparation)* 

Let us summarize the general rationale for this study* The kinds 
of considerations we have sketched led us to believe that questions 
asked by subjects during, the reading of a simple text would be 
diagnostic of important comprehension processes* It seemed plausible to 
assume that each sentence encountered in a text raises certain questions 
in a reader's mind and answers other questions raised by earlier 
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sentences. We wanted to explore this supposition in more detail by 
collecting data on the kinds of questions readers a*k\fol lowing each 
sentence in simple stories. 

*■ / 

This study used four tasks* Th6 primary task was one in which 
readers asked questions after reading each sentence in the story-* In 
another task a different group pf subjects read the same stories 
si lently whl le we timed the i r read i ng. These same subjects later 
recalled the stories, flnatlyt another group of subjects " rated the 
importance of the constituents of the story. Four short simple storie^ 
(maximum length was 1 sentences) were used as texts. They were alt ^ 
ch Tldren* s ^stor » es" or s i mple fo) ktaltes t / and a 1 1 were wel 1 - formed. 

To better understand the resul ts, a/ somewhat more detailed 
description of the four tasks^is necessary: , * 

/ ^ . Question-asking. All four stories were presented to 9 
subjects. Each sentence in the story was typed on a cardt and the 
subject worked his or h*r way through the deck of cards/ ask i ng 
questions that were raised in his or her mind as a result of having read 
that particular sentence. The subject was told to imagine that the 
story's author was presentt and that tne author was willing to answer 
any questions the reader J^ad about the story at that point* except f or v 
the obvious question of what happens next. The subject was allowed te, 
spend as much time^on any sentence as he or she desired, but was asked 
not t<? reread any previous sentences or to look ahead. The questions 
were tape recorded and later transcribed* The number of questions asked*, 
for each sentence was tallied and pooled over subjects. In addition, 
the questions %e classified in various ways. 

2. Read j ng ti mes . Sentence-by-sentence reading times were 
collected from 20 subjects. At the end of each syary subjects wrote a 
brief (3 to 5 sentences) summary of ttte story. 

t 

* 

3* Recaj 1 . The same 20 subjects were asked to recall the stories 1 
they had just read. They were presented with a brief descriptive title 
fey each story, and were given unlimited time to try to recall as much 
as they could. They were asked to recall exact words, but were 
encouraged to gue£s if they could not remember exact words. Recall was 
scored by first dqing a propos i t i ona 1 analysis of each story and then 
matching the subject's recall against this, using a gist criterion. 

k. Importance . Seventeen subjects re^J each story and crossed out 
the 50% L of the words, jihrasest or sentences in the story they felt w#s 
least important. For each sentence in each story the proportion of 
words left in aVeraged ovftr subjects provided a measure of the relative 
'importance of th^t sentence. 

It is useful to Jhave a better picture df what the question-asking 
data look like. Tab<£ 3 shews typical questions for the first sentence 
of one of the stories. These questions are grouped into those asked by 
two or more subjects and those that are idiosyncratic to one subject. 
Of course, we were also interested in the sentence-by-sentence variation 
in the questions asked- Figure 1 shows the total number of questions 
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asked for each sentence in each of the four stories. With the possible 
exception of EMERALD * there is noteworthy variation in the number of 
questions asked from sentence to sentence*. In EMERALD, there were a 
large number of questions at the beginning and then a fairly flat 
distribution of question* thereafter. Keep this difference in mind, 
because EMERALD will not follow the pattern of other stories in some of 
our later analyses. 

The first issue we addressed was whether the question-asking task 
is related to the reading times. Wt examined this by looking at the 
relationship between the total lumber of questions asked for each 
sentence in a story and the avtrag* reading time for each sentence for 
those subjects who were reading silently. The expectation was that 
sentences which elicited a lot of questions would be especially salient 
during real-time processing* and therefore would be read more slowly by 
subjects who were reading silently. This hypothesis was confirmed. We 
conducted multiple regressions in which the average reading time per 
sentence was the dependent variable, and the predictor variables were 
sentence 1 ength ► total number of quest i ons * ser i a 1 pos i t i on* and 
importance. Only sentence length and number of quest i ons emerged as 
significant predictors of reading time. In this analysis all four 
stories were entered* with story as a variable. There are two types of 
questions that occur: those that are asked by several subjects* and 
those that are idiosyncratic. We next asked whether these two types of 
questions contributed d i f f erent i a 1 1 y to this outcome. The answer was 
no. A multiple regression with number of questions diked by two or more 
persons and idiosyncratic questions entered separately showed that both 
emerged as significant predictors. Table U shows the details of these 
analyses. % 

When we carried out multiple regression analyses for each story 
individually, the results mirrored the overall analysis. In these 
regressions we included as predictors idiosyncratic questions and 
questions asked by two or more persons as well as total number of 
questions asked. For three of the four stories* at least one of these 
question counts emerged as a significant predictor of reading time (in 
addition to number of syllables). The exception was EMERALD* for which 
the Question data provided no significant predictor. Ae mentioned 
earlier* EMERALD was the story that showed little variation in number of 
quest i ons asked across sentences . 

So* number of questions asked accounts for a significant portion of 
the variance in sentence-by-sentence reading times. We next asked what 
relationship the question-asking task has with recall. And the answer 
was very simple: none. Table 5 shows the outcome of a multiple 
regression carried out on recall scores* and reveals that rated 
importance and serial position emerged as significant predictors of 
recall* while number of questions asked did not. This pattern is 
similar to other data wh i ch i nd i cate that importance predicts recall 
(Meyer, 1975: Kintsch, 197**) • Importance is not necessarily immediately 
perceived* but may result from having most or af 1 of the final memory 
representation of the text. We conclude from this that the information 
being revealed by the question-asking task is more closely associated 
with the activities that occur during comprehension than with the form 
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Table 3 

Sample Questions from The Sell ing of the ^qw 
Sentence U 

"Once there was a man named Cromer who lived on a 
farm that was way up on the side of a hi 11. 11 



Questio ns aske d by 2 or m ore subjects ; 
Who is Cromer? 
What is Cromer 1 ike? * 
Did Cromer live alone? * 
When did this story take place? 
Where was the farm? 
Where was the hi 1 1? 
Why was the farm on a hill? 
How far up the hill was the farm? 
How high was the hill? 
What kind of farm was it? 
What wilt happen to Cromer? 



# Sub iects 



2 

3 
k 

5 
6 

7 
8 

9 
to 
1 1 

_ld 

i 

V 

3 
u 

5 
6 



osyncrat i c questions asked bjt onl y sub ject : 



Does the fact that he lives on a farm have any 
s i gni f i cance? 

Does he farm for a living? * 
Does he have another vocation? 
Is Cromer marr ied? 
How old is Cromer? 

How far away were Cromer *s nearest neighbors? 
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7) Why did Cromer like to five on a farm? 

8) Are they going to roll something down the 

9) Did a lot of the dirt wash off the side of 

the hitl so that Cromer couldn 1 tihave his crops? 

10) What was Cromer's first name? 

11) Was that Cromer's first name? 

12) Then what was Cromer's last name? 

13) Did Cromer have more than one name? 
H) What kind of name is Cromer? 

15) What does Cromer mean? 

16) What nationality is Cromer? v 

*4 
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* Table 4 • 
Multiple Regression Analyses of Reading Time In Question-Asking Experiment 



Regress Ion 
Coef f Iclent 



S Ignl f Icence 
Level * 



Cumulative . 
R* 



Predl ctors selec ted : 
Sentence 1 ength 

Total number of questions asked 

predi ctors no t se 1 ec ted : 

Serial position of sentence 
Impor tance 



130, 22 
26 44 



.0001 
.0001 



,589 
,640 



predictors selec ^ d: 

Sentence length 

Idiosyncratic questions 

Number of questions asked by two 
or more subjects 

Predictors not se1 ected : 

Serial position of sentence 
Itnpor tance 



130.81 
40, 27 

87 42 



.0001 
,0004 

.0015 



. 589 
,626 

,652 



Mote: Forward stepwise regression, dependent var 1 able*mean reading time per sentence. 
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"*f the final memory representation constructed as a result of 
comprehension. 

^* 

this basic result confirms our initial supposition that the 
question-asking task would tap an aspect of what is going on in the 
skilled reader's mind while reading* The obvious 'question, of course, 
is what is it tapping? It is unlikely that a reader who is reading 
silently is actually asking questions while reading. Rather, we believe 
that the question-asking task taps the kinds of informational needs a 
reader encounters while proceeding through a text* As Vach sentence is 
understood and added to a growing representation of the story, the 
reader revises and elaborates the set of information still needed to 
have the developing story make sense* These informational needs 
interact with what is presented in the next sentence to generate a new 
set of informational needs—or, if you will /a new set of questions — 
that guide the reader's comprehension through the succeeding parts of 
the text. 

We have conducted a number of other analyses of these data that 
will be discussed in Olson, Duffy, Eaton, Vincervt* and Hack (in 
preparation). We have categorized the questions to see if certain types 
are more important' than others. So far* the categories we have examined 
have not shown any differences. We have also looked to see whether or 
not questions asked are later answered by the story* and there are 
interesting relationships here* Many questions are in fact answered* 
though it varies somewhat by type* However* ttie number of questions 
answered by a particular sentence does n o t predict reading time or 
recall* We have looked at the information tapped in the question* and 
find that questions which*are derived from new information contained in 
the current sentente are especially important in predicting reading 
times. These and other details of these data are interesting and' 
important/' and will be reported on fully in Olson et al. (in 
preparation) . 

The main findings of this study strongly suggest that the questions- 
asking task is a useful indicator of processes which may be an important 
part of comprehension. The number of questions asked by subjects as 
they read through a story correlates with th^ amount of time spent on 
that sentence by other readers reading silently* Keep in mind that this 
result is with the obvious effect of sentence length removed* But 
number of questions does not correlate with recall* Thus* question- 
asking seems more closely related to the real-time processes that occur 
during read i ng^ than to the final product of comprehension that remains 
when reading is completed* 

How general are these findings? We do not yet know* We have 
question-asking data for academic essays*, but have not yet analyzed 
them. Th r s wi 1 1 be done in the comi ng year . Further , we wi 1 1 af so 
analyze the pred i ct ion .data we have collected for both stories and 
essays. 
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Table 5 

Multiple Re^ress^n Analyses Of Recall In Question-Asking Experiment 

\ 





Regression^ 
Coef f iclent 


Signtf icance 
Level 


Cumulat i ve 
R f 


Predictors se 1 ec ted : 


* 






Importance 


341. i2 


• OOOi 


.235 


Serial position of sentence 


-2 94 


^ 0S24 


263 


Predictors not selected: 








Sentence 1 erigth 








Total number of questions asked * 









i 

Note: Forward stepwise regressions, dependent var 1 ab Ve=propor t ion propositions 
recalled per sentence. , * 



U 
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4, CONTROLLED READING TIKES * 

In our research we have assumed that the distribution of readings 
times across sentences is related to optimal reading strategies* „■ 
Specifically, we have^assumed that more time is devoted to those parts 
of texts that require or allow inferential and integrative processing* 
This assumption was tested by presenting the sentences of a text for 
experimentally determined exposure durations* Free reading data were 
collected for five short stories {range of lengths: 30 to 41 sentences)* 
These free reading times were regressed against sentence length, and two 
experimental conditions were created using the residuals of this 
regression* In the. Uniform condition, the exposure times for individual 
sentences were determined purely on the basil of sentence length, using 
the values calculated in the regression analysis; .In the Congruent 
condition, the average reading times for individual sentences in the 
free reading cond i t i on were used* In both experimental conditions the 
total 'study time. for each story were equal* "Wftat varied was how the 
time was allocated to individual sentences* « * 

Each subject read all five stories and wrote a short suifhnary of the 
story after read i ng each one* The f i rst story was a pr act i ce one, and - 
Hhe remaining four were the materials of pr imary i nteust. One group of 
21 subjects provided the free reading data, and a serond group of 8 
subjects provided controlled reading times (either Uniform or 
Congruent)* For the latter subjects, half their stories were in each of 
the twp experimental conditions* The practice story was always 
presented in the congruent condition* After fading all f i ve. s tor i es, 
subjects were asked to recall the four primary stories in as much detail 
and with as much gxact wording as possible. The order* of recall was 
i dent i ca 1 . to . the order of presentat i on* The story to b^teca 1 1 ed was 
cued by a lJ *hort title* The text of each story was givenR proposi tional 
analysis als outlined in Turner & Greene {1977) * and a gist criterion was 
used in scbring the recall. 

^ Subjects who studied the texts in the free reading condition 
"recalled 26*S|t of the propositions* lb the control led reading 
conditions, 33*9$ were recalled in the Congruent case and 32*9$ in the 
Uniform case* The later d i f f erence was not significant* 

The absence of an effect for Congruent vs* Uniform presentation 
condition led us to design a new study* Several factors occurred to us 
as relevant* First, perhaps processing of individual sentences is more 
flexible for some text types than for others* Second, perhaps some 
^subjects are less disrupted by a non-optimal distribution of time than 
others* Therefore, we designed a new experiment in which subjects of 
varying known degrees of reading skill were giveh simple essays to read* 
A large pool of subjects were given the Nelson-Denny reading test, and 
from this pooT subjects were assigned to high and Tow reading ability 
groups based on their scores*. Subjects in the free reading group 
provided profiles of reading times that were used to construct the 
reading times used in the Uniform and Congruent conditions. Free recall 
of the text was once again the dependent variable. 
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At the present time, the second study is*still being run. Pending 
its outcome, further studies along this same line may be conducted.^ 

5* EXPECTATIONS AND SENTENCE INTEGRATION 

This series of studies constituted Duffy's dissertation (Duffy, 
1983^* and has recently been submitted for publication* One endeavor 
within research on reading comprehension is to character ize how 
sentences are integrated into a coh^er^nt structure as the reader 
progresses through a text* Current approaches to sentence i ntegrat ion 
focus on backward search and inference processes to model the 
Integration process* This research examined the role of predictive 
processing in sentence integration. The research had two goals: 0) to 
test the hypothesis that skilled readers regularly make predictions as 
they read, and (2) to constrain a model of predictive processing by 
providing information about the processing consequences of having formed 
the prediction. The term "prediction 11 is used to refer to several types 
of forward inferences* from the minimal prediction of the general topic 
of the next sentences to a specific content prediction of what will 
happen next* w 

Three experiments were carried out* fn alt three* stimul i were 
narrative text fragments which varied in £he degree to which they 
generated a s'trong prediction at the end of the fragment* In the first 
experiment subjects were faster to respond that a target sentence was 
related to the text when it followed a Hugh Expectation (HiE) text than 
a* Low Expectation (LtfQ text* ( Subjects were also, faster to respond .that 
a target sentence was unrelated when it followed a HiE text than when it 
followed a LoE text* In the second experiment* when subjects read a 
target sentence which conveyed the next event in a script, they took 
longer when they had an incorrect expectation than when they had no 
expectation* The third experiment failed\to provide evidence that 
readers were forming a spec i f i c content prVdiction as they read. 

The results show that readers generate predictions as they read. 
Furthermore* these predictions are generated selectively (not for every 
sentence;), and they .have processing consequences, A correct prediction 
can facilitate comprehend i on, of the sentence where Ae prediction is 
fulfill ed . An i ncor rect. preqict i on can i nterf ere wi th ? the process i ng of 
a .sentence which violates the prediction. Tnis pattern suggests that 
predictions are allocated some attention when generated and become 
involved in the processing of subsequent sentences* 

These experiments fit nicely with, our earlier w£rk on thinking out 
loud during reading* That earlier work showed that readers readily made 
predictions while reading simple stories, and that the frequency of such 
pred i ct i ons cor re 1 a ted wi th the si I ent read i ng t ime& of d i fYerent 
subjects* The Duffy dissertation results show even more clearly that 
readers of simple stories make predictions that have consequences foV 
sentence-by -sentence pr jcess i ng . 
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A STUDY OF COMPOSITION . * • * 

As discussed in the introduction, a significant aspect of good 
writing is the ability to take into account the reader's perspective* 
The writer's task' is to communicate something to the- reader in such a 
Way that the reader can learn from the text in an orderly and efficient' 
way* 'The absence of immediate feedback is a significant handicap for 
the writer*. I n -convetrsa t i on» ,the listener usually signals when the 
speaker has gone astray or is unclear* But the writer must put together 
a complete text* a complete set of thoughts* without such- feedback* * 

* 

On the bas i % of our prior work on real-time processes in 

comprehension (Olson* Duffy, & Hack* 1 980 » r 1 98A ; Olson* Mack & D^ffy* 

198l)» we were interested in exploring the usefulness of process 

feedback to writers* We Had found, both in our formal research and in 

informal observations* that the information given by a reader thinking 

out- loutLwh i 1 e reading contained much information that appeared to be 

useful to tFte writer* The think-aloud data gave precise feedback about 

what reader* were doing* what features of the text they were reacting 

to* and what assumptions about the |Fext and the writer they were making* 

It occurred to us that this information might be useful to a writer* In 

order to make the feedback as clear as possible to the writer's we chose 

material for commun Teat ion that would have visible correlates of 

comprehension* namely* simple procedures* By having readers both 

Perform the procedure and thinSc out loud, the wni teri ought to have the 

most information possible about how wel 1 the readers were understanding 

the text* 
1 

i 

Another mot i vat 1 on for this work was tc fo 1 low up oh Hi 1 1 er ' s 
(1980} important study of the natural language description of 
procedures* In his study* college students were asked to write 
descriptions of how to do a file manipulation problem (looking up or 
modifying information in the personnel files of a hypothetical company). 
The type of problem was varied across groups of subjects* The texts 
were examined from a number of perspectives in-order to learn how 
computer-naive people would use natural language to describe a procedure 
similar to those that are typically programmed. Hiller (1980) reported 
a number of details of his data* but on.ly some of his broad conclusions 
win be reviewed here. Perhaps the most important finding was that 
people relied heavfly on the fact that those who would be reading their* 
descr i pt ions j^ere knowledgeable and intelligent/ Huch. that was relevant 
td communicating the procedure was left implicit in their texts* for 
"example* conditional statements were typically incomplete* The reader 
was told what to do when the condition was satisfied but nothing about 
what to do when it wasn't. In general* statements having to do with t„h& 
control Qf/iction were implicit or missing. Similarly* re/erences to 
other portions of the text were made implicitly rather than with , 
explicit labels or directions. These are striking departures from 
procedure descriptions for a computer* where everything must be made 
very expl \ c i t . 

These concerns converged to yield the following s^tudy* College 
students wfere taught two procedures. They then wrote a description of 
each procedure that could be used to teach another student how to do it. 
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Half of the writers had a series of readers read their texts* both 
thinking out loud and actually tryi.ng to perform the procedure* These 
reader sess ions, were videotaped, and later feach writer watched three 
different readers talk about his or her texts while read i ntf them! With 
the aid of this feedback, the writers revised their texts* A comparison 
gyfoup of writers revised their texts after the*passage of an equivalent 
afnount of time but wi thout any feedback* A series of global ratings of 
the texts were then obtained from a set of judges who had been taught"**- 
the procedures* Several general considerations mot i vated ,the analyses; 
Is process feedback of this sort useful for'rtvising such texts? What 
are the properties of effective natural language descriptions of * 
procedures- and how do they differ from ineffective ones? 

Since this research is only just now being written Up for 
publication, a more detailed description now follows. 

Sub iects . There were three different sets of subjects. The 
Wr i ters consisted of + 2J* college students drawn from a standard subject 
pool and paid for their .participation. There were 12 Experimental and 
12 Control Writers who were roughly matched on sex*, age* class In 
school* major* and computer experience* Data were also collected from 3 
extra Experimental Writers* to be used as described later. The Readers 
consisted of i*5 (36 for the 12 Experimental writers and 9 for the 3 
extra ones) college students drawn from the same subject pool as the 
Writers* Finally* the Raters were 12 graduate students and postdocs 
recruited primarily from the Human Performance Center* None of the 
subjects knew l^e purpose or design of the study* 

Tasks . In designing this study we considered a^wide range of 
potential procedures* Some were procedures that some subjects would 
expected to know and others would not (e*g** knitting)* white others 
were ones that few would know. In the end, we chose the Jatter type of 
procedure since we did not want to preselect subjects on whether or not 
they knew the procedures. Thus* fhe Writers and Raters had to be taught 
these procedures and, of course***' the Readers learned them f£om the 
texts * 

The two procedures were called Card' Sort and Fix. Card Sort was' 
^derived from a standard sorting algorithm in computer science. (Knuth* 
197 3) * ft consisted of a set of steps through-which an array of cards 
with numbers on them could be sorted Into increasing numerical order* 
Fix was a dice game we Invented. t A die is thrown five times and a total 
score is computed on the basis of an algorithm that has certain 
analogies'to the scoring of bowling* 

Tra i n i nq tapes . A, training video tape was made for each" of the two 
procedural tasks. Since the Writers and Raters were %o learn tfiese 
tasks on the basfs of these tape£^ we wanted verbal commentary to be 
minimal so as not to provide them with a linguistic basis for their 
task. * Thus* each procedural task was taught wfth as little language and 
as much gesturing and demonstration as was feasible. The same research 
> assistant performed the task in both the tapes* Each tape was 
approximately 8 minutes long* 
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Desi gn and procedure . The basic design of the study was a 2x2x2 
factor i al t cons i st i ng of Wr i ter ' s Cond i t ion (E x per i mental vs . Control) t . 
Version of Text (Original vs. Revised) and Procedural Task (Card Sort vs 
Fix). / ( 

Each Writer participated in an individual training and writing 
session with each of the two procedural tasks. Iff each of. these 
sessions the Writer first watched the training tape as many times as he 
or she wanted. The Writer then worked a series of problems until the 
experimenter was satisfied that the procedure was fully understood. 
Next the Writer wrote Instructions for the task that could be understood 
by a naive college student. They were allowed as much time as they 
wanted. Typically, it took from 60 to 90 m-inutes to complete the 
training and the writing of the original version of the procedural 
description. The Card Sort and Fix tasks were done in separate sessions 
a few days apart, counterbalanced for order. 

One to two weeks later, each Writer returned 4 for a second session. 
The Control Writers were given a typed copy of their original texts* and 
were asked to reread their description and revi&e it. No specific 
advice was given about how to revise. Each Experimental Writer was 
shown three video tapes o'f Readers thinking out loud whi le reading that' 
Wr i ter * s text. These Writers were told to use the. information contained 
in these tapes to help them revise their text. > 

Each of the 45 Readers was run individually^' Each Reader read a 
Card Sor*t and a Fix text* but from two different Writers. For each 
task, the Reader was gjven the materials needed for that tai&k. and the 
text, ^nd was told to try to learn how to do the task from tne 
instructions given. The* Reader was ,told to r^ad the text out loud and 
to keep their finger pointed at the portion of the text they were 
reading. They were also asked to think out loud about their 
understanding of the text, to report what they were thinking about and 
doing and to make comments about the te&t or about their understanding 
of it. They were told that a video tape of their session would be shown 
to the Writer as feedback about how effective the text was, so that they 
should make comments they felt would be helpful to the Writer. 

Each text was given a global rating by Raters who had been taught 
the procedural Casks. Each Rater received 12 pairs of texts, each pair 
consisting of the Original and Revised version for a particular Writer. 
Unknown to the Rater, half of the pairs were Experimental Writers and 
half Control. A pseudp-Lat'i n square procedure was used to assign a 
different set of 12 VwEters to each Rater such that each Writer was 
evaluated equally often, across all Raters (each Writer had six ratings 
per procedural task). The texts of the three extra Writers were given 
as the first three pairs for all Raters to minimize contamination of the 
ratings by start-up effects. Thus, each Rater rated a set of 15 pairs 
of texts for each procedural task. The ratings for the two tasks were 
collected approximately a month apart. 

For each pair of texts the Rater was asked to select which one most 
ef f ect i ve 1 y- commun i cated the procedural task. Since they had been 
trained on each task, they made this judgment from the perspective of 
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someone whp already knew the procedure* Once they had selected the most 
effective ruember of the pair* they rated on a 1-7 scale (1-hard, 7«easy) 
how e'asy it was to make the decision* For the Fix task, which was 
evaluated about a month later than the Card Sort task, twp additional 
judgments were made* One was a rating of how different the two texts 
w^re {1-very similar* 7"very different)* The other was an absolute 
judgment on a 1*7 scale (7"very effective) of how effective each member 
^ of the pair was on its own* These judgments were added after some of 

the preliminary data for the Card Sort task had beer* evaluated. 

\ 

Resul ts . The analyses to be reported here fall into two broad 
categories. The first set address the quest ion* of whether the feedback 
to^the Experimental Writers produced better revisions than those done by 
Control Writers. The second set compares the properties of the best and 
the worst of the descriptions, using a categorization scheme we have 
deve I oped. 

To give a rough idea of the size of the^e texts. Table 6 shows the 
^ average number of words for the texts in _e>£h of the eight cells ofxthe 
design. Note that on balance the revisions were neither longer nor 
shorter than the originals. This is because some writers revised in 
ways that produced longer texts* whereas others did so in ways that 
produced shorter ones* Further, these average changes did not differ by 
experimental condition or procedural task* However t Table 7 sheds 
further light on these effects. This Table shows the mean differences 
between Original and Revised texts, both algebraically and absoluteiyt 
as well as the standard deviations of these differences* A clear 
picture emerges. Though on average both Experimental and Control 
Writers produced no net changes in length, because some had longer 
revisions and some shorter* the magnitude of these Changes was larger 
for Experimental Writers. This is shown by the significantly larger 
absolute changes and by the significantly larger standard devrations # for 
both measures for the Experimental Writers. 

Another way to look at change would be to examine what proportion 
of the original text was changed on revision and --a somewhat different 
measure—what proportion of the revision appeared in the original. 
However* at this point these more difficult to compute^^measures have not 
been obta i ned. 

On balance* thent the Experimental Writers made, more changes than 
the Control Writers. Did they produce more effective texts in doing so? 
This -can be examined in several ways* Table 8 shows the proportion of 
Raters who chose thtf* revi s i orv as the more effective text for each 
condition and procedural task. These were evaluated by computing the 
proportion of RatersVho chose the revision as the better -Of each 
Writer's text. Though there ts a trend in the direction of the 
Experimental revisions being consistently more effectivet this trend was 
not statistically significant. Similarly* the difference between the 
two procedural tasks was not significant. < 

Were the revisions on average better than the original texts? This 
is evaluated by the extent to which the revisions were selected more 
often thdn the chance value of 503. The two cells for the Fix task did 



9 

ERLC 



final fteporu Nit (.-^-0133 



Tab I* 6 

ftaan Numb a r of Word* par Taxt 



Talk 


Control 

t 


* Experimental 


Or iglnal 


Ravi i«d 


Original 


Ravi lad 


Fix 


333 


35) 


366 


386 


Card Sort 


575 w 


570 


1*1*1* 


1*25 



Table 7 

Mean Difference in Length Between Original and Revised Texts 



Task 


Signed 


Di f f erence 


Absolute 


Di f ference 


Contro 1 


Exper imenta 1 


Control 


Exper imenta 1 


Means 

Fix 


18-3 


19.9 


18.7 


1*0. 1 


Card Sort 


-^3 


-19-5 


21.9 


1*6.5 


Standard Dev i at i ons 










Fix 


2i*.8 


W.8 


21*. 5 


31.1 


Card Sort 


3^3 


79-9 


26.0 


66.7 



Note; Entries are mean words revised minus mean words original 



not differ significantly from chance (.05 < £ < .10) but both cells for 
the Card Sort task did (g < .05). Thus* the revisions were generally 
improved over the originals, but not differentially as a function of 
experimental contii tion--at least within the statistical power of this 
pre I imi nary study . 

Another way to took at this is to examine the overall ratings of * 

text effectiveness that were obtained only for the Fix task. These are 

shown in Table 9* Statistical evaluation revealed that neither 
condition nor version affected these ratings. 
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Tab It 8 

Proportion of Raters Choosing Revision at Better 



Task 


Cond 1 t ion 


Control 


Exper i mental 


Fix 


.62 


.65 


Card Sort 


• 70 


.81 



Table 9 

Rated Text Effectiveness for Fix Task 



Cond i t i on 


Version of 


Text 




Original 


Revi sed 




Control 


<• -3 






Exper imenta ) 


it. i 


it. 1 





Note: Rating scale was 1*7, with 7 being most effective* 



So, to summarize these preliminary analyses* Experimental Writers 
made more changes in their texti but did not produce revisions that were 
rated more effective than those of the Control Writers. Before 
discussing these findings, some cautions need to be pointed out* 
Clearly, a number of other analyses of these data must be performed. 
The measure of change reported here~-the difference jlp overall length 
between Original and Revised texts—is an extremely Aide one. Other 
measures of change that are more sensitive to the content and 
organization of the texts will be obtained before the conclusion that 
more change is made by Experimental subjects is completely accepted. 
Further, Lt is not just amount of change but also the nature of the 
changes that is important* and these too will be eva luated . Similarly, 
the measures of text effectiveness described so far are limited. The 
data in Tables 6 and 9 are based on global judgments by Raters who were 
trained on the procedural task and who carried out a number of ratings. 
Judgments by raters who were actually learning from the texts or 
performance data of subjects trying to use the texts to learn (as in the 
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video tapes we have for half of the Original texts) would be^ i nf ormat ive 
alternatives to the data in Tables 8 and 9* Similarly, more 
conceptually based evaluations of the content and organization of' these 
texts can be carried out. Such further analysis may lead us to qualify 
these initial impress ions ,of these data * 

We also have a considerable amount of information about the 
properties of half of the original texts, in the video-tapes of Readers 
thinking aloud while learning the procedures. We have not even begun to 
evaluate these data* They contain a wealth of information about the 
features of these texts that were easy and difficult to understand and 
how such features were used in the Experimental Writers' revisions. 

The preliminary analyses we have carried out* along with our 
informal impressions fromhaving watched subj ec t^£e i ng run and having 
informally sampled from the Reader tapes, show that the Experimental 
Writers had available to them in these tapes much more information than 
they used* If this impression is correct* why did th$y not use the 
information? There are two sets of reasons* The first is motivational 
or emotional* We obtained three Readers for each Writer's texts to 
forestall the possibility that the Writer could dismiss any difficulties 
he observed as the fault of any particular Reader* To our surprise, 
even when they saw three different Readers having more or less the same 
difficulties, a number of the Writers still attributed the problem to 
the Readers and not to their own tfext: They would make comments like 
"Stupid readers 11 or "It's all there in the text*" Indeed* the single 
most common revision among the Experimental Writers was to put a 
statement at the beginning of the text which asked the reader to read - 
the instructions carefully! A second type of reason why the feedback 
was not more effective is that even when the Writer decided there were 
problems with his or her text they may not have known exactly what to do 
about them. Ne<< research we have planned will address many of " these 
questions* * 

Another class of analyses we have been working on is the 
classification of the content of the descriptions. Using several 
sources as starting points**' including our own intuitions about 
procedures and rti 1 1 er 1 s " ( 1980) descriptions of the content of his data* 
we have developed a scheme for coding the content of our descriptions. 
Our cur rent, cod i ng scheme is described in the Appendix B* Basically* 
this scheme classifies all of the content of each description iflto 10 
categories of two broad types* The first type are those that have to do 
with direct statements of how to do the procedure* referred to by the 
heading of Procedure (see examples in the Appendix B) • The second broad 
type are supplements to these direct statements* such as overviews* 
summaries, and examples (see the Appendix B) . Since these all pertain 
to material whose aim is to help the reader* we refer to this set of 
categories by the general heading of Gu i dance . 

We had a number of specific questions in mind as we developed these 
classes: How does the content of effective and ineffective descriptions 
differ? Do different procedural tasks elicit different types of 
descriptions? What type of content do Readers tend to have the most 
trouble with 7 What type of content is most likely to be revised by 
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Writers? What is least likely to be revised? $oes this vary wi th \ 
procedural task or experimental condition? Do skilled wr i t^rs revise 
differently than unskilled ones? *V 

At the time this rfcport is being prepared, only the first of these 
analyses has been completed. However, the' results of this first 
analysis are quite provocative. Fpr the Fix task where we had direct 
ratings of text effectiveness for each of_ the texts, we selected the 
four highest and the four lowest rated texts. We coded these texts 
using the scheme in the Appendix B. Several startling properties 
emerged, and are shown in the data summarize^ in Table 10* If we look 
at the overall proportion of text content devoted to d^ect description 
of the Procedure versus the content devoted to Guidance, we find a 
complete reversal between the' best and the worst texts* Roughly two- 
thirds of the content of the best texts Is deyoted to Guidance and only 
a third to Procedure, while for the worst texts the proportions are 
reversed* Moreover, much of the difference is due to the presence of 
Examples ^Roughly # third of the^content of the best descriptions is 
taken up with examples, wjiile only about ten percent of the worst ones 
are* Indeed, two of the four bad texts did not haye an/ examples at 
all. This suggests that examples ^n particular and thejtind of content 
coded by our Guidance categories in general may be important components 
of effective descriptions of procedures* 

While these data suggest tHis, the conclusion is not firm. A 
number of issues need to be addressed, and these will be a major part of 
new research, we hope to oonduct* .fWhat are these issues7 First, we have 
shown a correlation, but we do not know 1 f 1 the relationship is causal* 
Maybe our best texts' were simply written by the smartest or most 
literate subjects. Second* how general \t this finding? We need to 
examine other procedural tasks and other descriptive situations. Third, 
text effectiveness was measured by global ratings* Such ratings have a 
number of we 1 1 -known 1 imi tati ons (Cooper ,. 1977) * Thus , al ternati ve ways 
of measuring text effectiveness need to be examined, both with our 
current data and with new data we hope to collect, 

SUMMARY AND FUTURE PLANS 

* 

The program of research funded by this grant focussed on 
discovering the higher level strategies used by readers in comprehending 
simple texts. .A variety of complex data have been collected in order to 
discover what these strategies are like. In addition, an initial, 
preliminary study has been carried out of how writers take into account 
the way in which their text wilt be understood by readers. 

In a sense, the major purpose of the research has been to f i 1 1 in 
details of the conceptual scheme sketched in the introduction to this 
report and described in greater detail in Olson et al, 0980, 1 98 1 ) * 
After three years of work the scheme appears to us as useful as it did 
at the outset. But now many of the concrete details of what readers are 
doing have been filled in. 
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. . Table 10 

Properties^-of Best and Worst Rated Texts for Fix Procedure 

* 1 Content 

/ Subject Mean length ■ — ^ 

Rat ! ng' ~ Procedure Qui dance (Examp les) 

Best Texts - ^ . * 



-2 


6.1 


518 


• 19 


.80 


-(•35) 


4 


5.8 


455 


.26 


.71 


(.63) 


15 


5-8 


55* 


.42 


• 58 


(.27) 


21 


5.8 


515 - 


• 54 


.42 


(.12) 



Mean 5*9 5] ' .35 -63 < - 35) 



Worst Texts 



12 


2.8 


421 


. .89 


.09 


(0) 


16 . 


2.2 


428 


.50 


.50 


. (.24) 


2'2 


3.0 


145 


,88 


.12 


(0) 


26 


2.5 


746 


, .62 


• 36 


(.18) 



Mean 2.6 435 -72 *27 (.11), , 



The work started during this grant is not yet completed. Several 
of the studies are still in progress, and the large data bases collected 
through the use of the thinking-out-loud methodology have not yet been 
completely analyzed. In turn, there are yet a number of journal 
articles to prepare. These activities will be pursue^ during the coming 
year (83-84) * 

The preliminary study of writing carried out towards the end of the 
grant represents the major new line of work to be pursued in the future* 
Already, grant prpposals for new research on writing have been prepared 
and submitted to several agencies* Over the next few years a vigorous 
program of research on the nature of writing will be carried out. 
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TALKS AND PAPERS 



Ta Iks and Presentat i ons 

Olson, G*M* The process of story understanding. Talk presented at the 
Knowledge Representation Workshop, Brown University* June i960* 

pison, G.M.* Mack* R** & Duffy* S. Strategies for story understanding. 
Paper . presented at the Annual Meeting of the Cognitive Science 
Society* Yale University* June i960. 

Olson, G.M., Duffy, S*A., Hack* R.* Vincent* P., & Eaton* M* Cognitive 
processes during text understanding* Paper presented at the 22nd 
Annual Meeting of the Psychonomic Society* Philadelphia* November 
198K . 

Olson* G*M, Talk-aloud protocols as a method for studying text 

comprehension. Talk given at the Conference on M New Methods in the 
Study of Immediate Processes in Comprehens i on, " University of 
Arizona, December 1981* * 

Duffy* S*A*, Dlson, G,M, # Mack* R,U* Vincent* P*L* # 6 Eaton, M* 

Readers' use of genre conventions in understanding and recalling 
academic essays* Paper presented at *the Annual Meeting of the 
American Educational Research Association* New York* March 1982* 

Olson* G *M* # Duffy* S*A. # Eaton* M** Vincent* P,L* # & Mack, R. L* On- 
line question-ask ing as a component of story comprehension* Paper 
presented at the Annual Meeting of the American Educational 
Research Association* New York* March 1982* 

Olson* G,M, Discussion* Paper presented as part of the Symposium on 
the Psychology of Questions at the Meeting of the American 
Psychological Association* Washington* D.C,, August 1982. 

Olson* G*M, Natural language descriptions of procedures. Talk given at 
Bel 1 Laboratories* Murray Hill* New Jersey* February 1983* 

Olson* G.M** Trahan* M,* & Roshwalb* L * Natural language descriptions 
of procedures* Talk to be given at the Annual Meeting of the 
Psychonomi«p Society, San Diego, November 1 98 3 - 



Publ ications (* indicates i terns* included in Appendix C) 

*01son* G*M,* Duffy* S*A** & Mack* R*L * Applying knowledge of writing 
conventions to prose comprehension and composition* In 

' W,J, McKeachie (EdJ * learn i nq t coqn'r tion, and col 1 eqe teach ? nq * 
San Franc i sco: Jossey-Bass* i960 , 

*01son* G,M** Mack, R, # 6 Duffy* S* Cognitive aspects of genre. 
Poetics * 1981, JO, 283-315- 
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Olson* CM. On language understanding process (in Chinese). Shinl i 
Kexue Tonxuin * 1981* 2* 70-7**- 

*01son* G*M.* Duffy* 5. A** & Hack* R*L* Thjnk ing-out-loud as a. method 
for studying real-time -comprehension processes* In D* Kieras^S 
M. Just (Eds .) * New methods i n the study of hnmed i ate processes i n 
comprehens ion * Hillsdale* New Jersey: Lawrence Erlbaum Associates* 
1984* 

*01son* C*M.* Duffy* S*A.* & Hack* R*L* Question-asking as a component 
of text comprehension* In A* Graesser S J, Black (Eds*)* The \ 
psychology of questions * In press* 

*0uffy* S*A* The role of expectations in sentence integration* Ms* 
submi tted for pub'l i cat ion * * 

Olson* G*M** Duffy* S*A** Eaton* A*E . , Vincejit* P** S Maclt* R*L. On- 
line question-asking as a component of story comprehension* Ms* in 
preparation. * 

Olson* CM** Trahan* M** S Roshwalb* L* The composition and revision of 
-natural language descriptions of simple procedures* Ms* in 
preparat i on* 



Publ i cat ion Plans 

* 

Several other uncompleted portions of this research are likely to 
lead to publications* The detailed analyses of the thinking-out-loud 
data using the scheme in Appendix A should produce a manuscript 
(possible of monograph length) on, the detailed strategies of readers* 
The experimental work on controlled reading times will be published if 
the results of the current study (and any planned follow-ups) warrants* 
Indeed* ne suspect that the rich data we have on hand for l>oth 
comprehension and compos i t i on .may lead to a number of other 
presentations and publications beyond those currently planned* Copies - 
of all subsequent publications that result from the project will be 
forwarded to NIE* 



i 
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APPENDIX A 
Scheme for Coding Think-Aloud Protocols 



The format for coding a protocol according to this scheme will be: 

y 

OP code[Att code (seg code)] 

The attention codes which are outside the parentheses and inside the 
brackets define the general category of context in-formation being 
focused on. The entire unit containing the attention code and segment 
code is called an Attention Unit*. The operation codes which are outside 
the brackets define the cognitive operation carried out-on the content 
within the brackets. If an object of an attention unit is a clause then 
the clause is characterized by an X and is defined in a separate 
attention unit. It is not necessarily going to be the case that all of 
the arguments shown for the attention codes wUl be filled* Only those 
that are minimally necessary should be Included* Dummies can be used 
for necessary roles that are not mentioned* It is also possible for s 
more than one OP Code to appear for a given segment of the protocol if 
It happens to be an especially complex one. Likewise more than one Att 
code can be used for each OP code* 



A ttent ion Codes 



* 1* PAct (verb* aQent t object . i nd i rect object, instrument! * Intentional 
actions of a character. They do not i nc lude j hab i tual actions of a 
character, but rather specific actions that occur at one point in time 
in the story* This also includes verbs which summarize a set of facts 
(e*g*, to plan, to organize)* 

e*g* Lentil played the harmonica for Colonel Carter. 
PAct (pi ay t Lent i l' t h^rmon^ca* Car ter) 

Actions which are negated are Pacts* 

e.g*, Lentil did not play his harmonica* 

\ 

(Close mi?s: The musicians could not pucker - Pstate) 

" * ' > l 

2* ty (vepb, agent, object) . An event is anything that actually happens 
to a character or object as a result of a non- i ntent ional internal 
cause (e*g * *b lowi ng up) or an outside force (e*g. being blowrt away by 
the wind)* Any noticeable change in the general conditions in the story 
should be coded as an event (e*g., weather changes, dawn or dusk). If, a 
statement is ambiguous as to whether it should bflj^n act or an event 
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(i*e.* the intentional i ty of a character is difficult to di scern) t M t - 
should be classified as an Event* 

Le»g . T^e wi nd b 1 ew Lent i 1 over . 1 
|v (blew over*w*nd*LentM) 

e*g.# The mountain blew up. 
Ev (blew up, mountain) 

e*g*# Dawn arrived* 
Ev (dawn) 

by convention* general statements in which it is impossible to tell /O 
whether a subject intended an Action or an event are coded as Ev* 

e.g* # something will happen* 

Pred [happen* somethi ng) ] 



3* HAct tverb, agent, object) * A mental action or event such as 
thinking, deciding, learning/ forgetting. This does not include 
habitual menta f act ions that a character constantly performs (which are 
classified as H^Macts^ . 



e.g* The stranger learned about the town, 
HAct (l earned * stranger * towns f ol Ic) 



l*. MStat^ (agent.state) . An emotion or belief that a character is 
experiencing./ These are non-enduring mental states. Ensuring emotions 



or be) 



i enc i ng y 
I i eTs^are 



coded as Chars* 



e*g.The stranger was disappointed* 
HState (str « disappointed) 



5* PState (a^entf state) . The physical state or condi tion of a 
character or an object. These are non-enduring traits* such as being 
hungry or cold (enduring physical traits are coded as Chars). They can 
also refer to an Inanimate object and a temporary state that it may be 



e.g. The stranger was cold* 

PState (str«cold) 
* 

The boat was filled with people. 
Pstate (boat* f i I led with ptf&ple) 



6* Poss (possessor;possessed) . ■ This category shows ownership or 
possession* 

e.g* This is the woman's house 
*Poss (Worn- house) 



9 
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7 * Char (topic .character i s t i c) « General endur i ng , character i s t ics of 
both a character or an inanimate object. This does not include 
characteristic actions physical or mental (which are coded as H-Pact or 
H-Jlact) - A Char could include a period of a person's past e*g* Lentil 
lived In Europe*, Segments in which it is ambiguous as to whether the 
attention code^ should be an H-Pact or an H-Jlact are to be coded as a 
char * e *g * , Lent i 1 tr i es hard * 

e*g* The house was clean* ■ * 

m Char (house* c 1 ean) 

The boat was smal 1 " 
Char (boat, smal 1) 



8* Goal {agent, goal) * Statements which convey the need* desire, or 
motive of a character are not classified as Chars or Estates* Rather 
they are classified as Goal s , Host goal statements will contain an 
embedded clause which actually states what thegoal is* This embedded 
clause is coded* 



e*g** Lentil wanted to make music, 
Pact (make* Lent i 1 *mus ic) 



Goal (Lenti 1*X) x*H- 



9* Loc (relation* located ent i ty * local i on 1 * I ocat i on2) * Oescr ibes *tfae 
location of an .action* entity* or event involving specific characters, 
or other entities* That is* these»are the locations of specific thingsi 
as distinguished from the general Vocation of the story, which is an 
aspect of Set* _-^* V 

e*g* The. boy was under the bed* 
Loc (under * boy* bed* 0) 



■L 



10* Set (property)^ General characteristics of tl\e setting, such as 
the weather* general conditions that hold* the historical period* and 
the general location of the story^ 

A 1 to i s i n Oh i o 

Set (A 1 to* in Ohio) • 



11* Und (object) « Some story content got mentioned with no attention 
category * » 

e.g* This is Lenti 1 * 
Und(LentM) 

12. LL (t ^me reference) » Expl i c i t reference to the t i me 1 i ne of 
actions and events in the story. Reference to something happening now 
is not coded as Ti unless it is marking a change of condition from an 
ear 1 i er t i me (i *e. . an expl i c i t contrast with an ear 1 i er t i me) . 
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> 

• - 

Lentil met Carter after the parade. 

Pac t (met, Lent i 1 * Carter) , ti (af ter the parade) 

\ 

If the "time phrase" conjoins two clauses* each clause is coded with 
its own Aft code* and the "time phrase' 1 is coded as Ti : 

e.g** It wtTl start raining as soon as he gets out of his car. 
Pred[£v (rain)l,Ti (as soon as X) * X* Pac t (get out of#car>] 

Predictions are not coded as Ti unless they pinpoint the future act or 
event on ttie story timeline. 



e.gj, Ntfxt, Lentil will play his harmonica/^ 
Pre<ttPafctJp1ay, Lentil, Harmonica) *Ti (next)] 



(Close miss: Colonel Carter will meet Lentil sometime in the future ~ 
Ti is not coded here) * 



^3* S t p (asPect*content) » A residual ^category for attention to 
general characteristics of the story* Two kinds of statements are 
typically labeled Sto: 



general statements .about the story itself: 
The story seems to be about Indians* 
Sto (l nd i ans) 



"more specific statements about story content where no other attention 
code fits: 

We will meet Colonel Carter later on 
Sto (Carter) 



This secopdMype of Sto is often confused with an Und and an £v. 
Confusion >rth Und: While the above statement at leatet has an implicit 
reference to the story as a whole (i.e,* that we will meet Carter later 
in the story), the typical UndvdOM not* (e.g.* "Here's Colonel Carter 
Und (Carter) * \ I * *"* 

Confusion with Ev: While the verb "meet 11 is normally classified as an 
Ev, the subject of the Verb is not a story character. Thus the 
"meeting 11 is not a story event and is not coded as an Ev. 

Sty (aspect, content) .* Reference to the form of the language* 
purpose of the sentencet or the way i ■ was written including vocabulary 
syntax* and author's style. No story content should be mentioned. 

* Selfish is an unusual word to, chose. 
Sty (unusua 1 * sel f i sh) 

-** 

That sentence really doesn't say much. 
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Stytdoesn't say much) 

15- H-Pact (verb* agent, object, t nd i rect object, instrument) 
H-Pacts are habitual actions of a character* It Is something that the 
character is known to do routinely throughout the story* or is given as 
background about a character^ If it is ambiguous whether a , segment 
should be a H-Pact or 'a H*Wact then ft should be coded as a char, 

e.g. Lentil played his harmonica on the way to school* 
H-Pact (played*Lenti 1 *harmonica*on way to school) 

16, H-ttact (verb taQentt object) 

H-Nacts are habitual mental actions of a character* This would include 
a habitual thought of a character br a mental action that a character 
performs' throughout the story or is given as background information - 
about him. 

1 7 * Perc (percept ion. character t object) 

A character perceives something through one of his senses. These are 
not intentional actions such as 1 poking or listening* but rather seeing 
or hear 1 ng. ^ * 

* 

e.g.* The 2 men saw the canoe* 
Perc (saw* 2 men, canoe) 

18, Ident (o£jec t i dent i f Y i nS. Purpose of ob iect) 

When the identity of an object or a character is being attended to. 
These are always comments about anaphbric reference* e.g.* the referent 
of. a pronoun: 

Is "he M the first Indian? 
Ident (he, f i rst Indian) 

The coref erentiaM ty of two noun phrases 

This is "the one thjng*' ,to make Lentil unhappy 
Identtthe one thing) 

I expect that's rain hopefully, 
ident(wet sound*rain) 

What is the one thing to make Lentil hippy. 
Ident (what one thing*make Lentil happy) 

n Opera t i ona 1 Codes 

K Que , The subject asks a question about the story. It can be 
implicit or explicit, e.g. "I wonder where WensleYdale is" A question is 
also any statement in wj>ich the subject asks for more information. 
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Certain indirect Que's are easily confused with Gcoma. In general, if 
the indirect question concerns a character or object that is introduced 
in the current sentence* It is probably a question. If It has been 
mentioned before, or if there is no reason to suspect that the subject 
is confusedi It is a Gcoffl. 



2. Rep. Something is repeated directly from the current sentence in 
the story . ^ 

3* I The subject repeats something that was stated earlier in the 

text. If there is no explicit reference to the earlier text* code it as 
T Ret[Und(Q)]. (See also Gcom) . 



*• • £ Hfit . The subject repeats something that he stated earlier in his 
protocol (that was not stated earlier in the text). Pret takes 
precedence over Pred or Inf and other similar operation codes* Pret 
indicates a protocol statement in which the subject does not generate a 
new predictiorKor inference but rather retrieves an old one* Thus the 
retrieval operation Is coded* 



5* Pred . The subject makes a prediction about what he expects to read 
about next or later on in the story. Pred can afso be thought of as 
inferences stated in the future tense. 



6* in!* The subject infers something from the essay that is not 

stated* You need to look at the story to distinguish whether something 

is being inferred or not. Inferences which are stated in the future 
tense are classified as predictions* ) 



7. GK* The subject states something that is general knowledge* e.g. 
"Ohio is a Midwestern state. 11 "You need to know" is often a lead in for 
a GK. 



8. Cob * The subject says something about his own behavior t thoughts* 
or feel ings. 

e.g.* I think I read this story before. 



9* NCom . These are negative comments that people make about the nature 
of the textt such as "This doesn't make sense". If it is ambiguous 
whether the segment is negative code i t as 3 GCOM* 



10. PCom. These are positive comments people make about the text. 
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11. GCom . General comments that are neither specifically positive or 
negative. These comments include indirect questions concerning a 
character or object mentioned earlier in the story (see Que) when it is 
clear the subject is not confused. 

You'll have to know who the speech was for* 

You ' I I have to know who Old Sneep i s . 

Not'ce that these Gcoms are characterized by a WH-question word 
following the **need to know" phrase. Statements taking the form "You 
need to know that " are usually followed by a fact or inference from the 
story. These are not Gcoms but Trets or Infs. 

e.g.,* You have to know that Old Sneep sat and grumbled. - Tret 

12. Conf . The subject confirms a prediction as being carried out in 
the story. e,g, "Just as I thought* the stranger was let in." 



13* Oi sconf » .The subject admits that a prediction that he-made was 
wrong* or an inference drawn was incorrect/ The prediction and 
inference do not have to have been explicitly stated. 



14. Sum . The subject summarizes and cotnbi nes i deas from earlier in the 
text, or it can summarize one sentence. 



Hi rits on cod i ng - 

frequently* much of what a subject says can be captured by a single Op 
or At code rather than a more complicated coding* For example: 

to indicate the k i nd of person who/tfould sit and grumble 

Gcom[HPact (s i t and grumble, Old/Sneep)] 
HPact captures underlined por t i on *^P^statement 

thj s Sentence refers back to the fact that he can't sing. 

Tret [Char (can 1 1 sing* Lentil)]. 
Tret captures underlined portion 

You wou 1 d have to know who Old Sneep is to understand the sentence 

Gcom[ident (Old Sneep)] 
Gcom captures the underlined portions* 
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APPENDIX B 



Coding Scheme for Descriptions of Procedures 



Categor ies Fertaini ng Primari ly t o the Loqi c of the PROCEDURE 

1* Act i on [ACT] * The physical or mental actions performed as part of - 
the procedure* By convention, this category is used for the full 
predicate* Negative acts arm also ACTs. Examples: " F i nd the middl e 
card ," "Put your left hand on the leftmost card*" "If the card below 
your left hand is less than the card below your right handi don' t move 
the cards , 11 (In the examples* the underlined portion refers to the part 
coded as the category being described*) 

2. Oual i f ication [QUAL] * Qualifications placed on actions* The test 
on whether something is ? QUAL 1 rather than part of the ACT is whether 
the action has reasonable alternatives other than the one described. If 
sex* it is a QUAL* Examples; "Put your left hand on the leftmost card " 
( r i ght is a reasonable alternative to lef t » above * center > etc* are 
reasonable alternatives to on the 1 ef trodst card} » 



3* Condi tion JLCOjjl* The conditions relevant to performing an act* 
using the typical if-then logic common to programming* The entire 
condition is classified as a CON* That is* the subparts are not 
class i f ied as QUALs or other plausible categor ies* Examples: " I f the 
c a r d below your 1 ef t hand j s 1 ess than the card below your r i ght hand * 
don't move the cards*" "Continue shifting your hands to the right unt i 1 
your r j gh t hand i s no longer on the top of a card *" Note: Sometimes a 
writer will state a rule such as* "Rolls of one* two* three* four* score 
one* two, three or four points respectively*" We code these as an 
implicit condition and action* so that "Rolls of one* two* three* four*" 
is the condition* the remainder the action* 

k. I ni t ialization ClNIT] * Statements which describe the materials. or 
other conditions relevant to setting up to do a procedure* Examples: 
" You are g i ven a de ck of cards and someth i nq to be used as a marker *" 

5- Repeat or contj nue statement [REP3 * These are statements which say 
at a general level to repeat or continue an action already described* 
If the steps are elaborated or repeated again* the entire text fragment 
that includes the elaboration or repetition is classified as a REP* 
without any further coding of the internal constituents* Examples: " You 
cont i nue thi s procedure unt i 1 the cards are in i ncreasi ng order from 
left to right. 11 " Conti nue steps D £ £*" " Perform steps A through G 
agai n ." "If your left hand is on the last card on the left* go to step 



Categor i es Per ta i n i nq Pr imar i 1 y to the GU I DANCE of the Reader 

6. Overvi ew [OVER] . Statements that are overviews of the objectives, 
goals* or content of the procedure. General titles for a description 
are coded as OVER* Examples: "These are your instructions for a card 
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sor t inq procedure ." " Th is procedure al lows one to order any number of 
cards f rpfi) the lowest to the highest number ." 

7. Summary [SUtt] . Statements that summarize in a general way parts or 
all of a preceding description of a procedure. Examples: 

8. Organizational Markers [ORG] . Explicit indicators of the sequence, 
organization, or structure of the parts of a procedure. Headings or 
labels for sections of the description and step numbers are examples of 
ORGs. Examples: "Now, shift each hand to the right." " To begin , cards 
are dealt out* face up, from left to right*" "J^ Odd number " . 

9* Exampl es [EX] . Examples* illustrations, analogies used to convey in 
an explicit fashion the steps of a procedure. Examples: " For i nstance 
i f you are work inq with J cards you wi 1 1 fee marki ng the 6th card *" M We 
wi 1 1 use (7) seven, for exampl e »" 

10* Cogni t ive A_i_d [COG A ID] * These are statements inserted to help the 
reader. Specific typei of statements include warnings* reminders* 
attention directions, tests for the reader to check on comprehension* 
etc. Examples: " PI ease read through the instructions once and then go 
s tep by step . 11 
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APPEND I & C 
Publications Enclosed 



A copy of each of the following publications is enclosed: 

Olson, GiHk Duffy* S.A*» £ Hack* R*L. Applying knowledge of writing 
conventions to prose comprehension and composition. In 
W*J* rtcKeachie* (Ed*) , Learni nq. cogni t i on» and col lege teach i nq * 
San Francisco: Jossey-Bass* 1980* 

Olson, G*rt*» Hack* R*» £ Ouffy* S* Cognitive aspects of genre. 
Poetics, 1981. K>. 283-315* 

Olson* G*rt.» Ouffy* S*A*» £ Hack* R*L* Thi nk i ng-out- loud as a method 
for studying real-time comprehension processes* In 0* Kieras £ 
rt. Just (Eds.) , New methods in the study of immediate processes rn 
comprehension * Hillsdale* New Jersey: Lawrence Erlbaum Associates* 
198i»* 

Olson, G*ft* t Duffy* S*A*» £ Hack* R*L* Question-asking as a component 
of text comprehension* In A* Graesser £ J* Black (Eds*) , The 
psychology of quest ions * In press* 

Duffy, S*A. The role of expectations in sentence integration* Ms* 
submi tted for publ i cat ion* 1 
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^killed wirier* employ the conventions of writing used in that 
field oj study and skilled readers know thest conventions writ. 
Teaching writing may involve making thest conventions mart 
explicit to students. 



Applying Knowledge of 
Writing Conventions to 
Prose Comprehension 
and Composition 

Gary M. Olson 
Susan A. Duffy 
Robert L. Mack 



ERIC 



"Reading makcth a fufl man, conference a ready man, and writing an 
exact man," wrote Sir Francis Bacon, Reading and writing have long 
been viewed «s among the highest achievements of human culture, but 
literacy is essential to modern technological society, and deficiencies in 
reading and writing arc considered major social problems. Despite the 

tn ennducting research for this chapter, one or more of the authors received 
support from the following sources; » P.;*5^h Career Development Award from the 
National Institute of Child Health ancHJuman Development (I ID 00169), predoctnraJ 
training grant from the National Institute of Mental Health (MH 14254), and » B r * nt 
from the Horace II Rack ham School of Graduate Studies. 
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obvious importance of these skills, we still know very little about how 
the mind executes the complex tasks of understanding prose or com- 
posing it* lite study of prose comprehension has only recently entered 
the mainstream uf cognitive psychology, while |hc study of writing has 
nut yet made it* 

Recent research on the way in which human beings process 
printed prose has focused on what the reader remembers from the text — 
in particular, in Umt cither the substance of the text or its form influ- 
ence what a reader remembers* Much less attention has been given to 
what the reader is doing while reading* Only recently have some initial 
efforts been made to develop models of the reader's general strategies 
for -reading a text (such as Collins, Browr>, and Larkin, in prc&s; Hayes 
and Simon, 1974; Kintscti and van Dijk, 1978; Kintsch and Vipond, 
1978). 

In this chapter we will present some components of a model of 
prose understanding. In particular, we will examine the knowledge 
that readers have about the conventions of prose composition and what 
effects this knowledge has on comprehension. We wilt also offer some 
thoughts on the implications of our analysis for the study of writing. 

Communication, Conversation, and Convention 

Most social interactions arc governed by norms or conventions. 
Language use is no exception. Grice, in an influential set of lectures 
(1967, 1975) described some of the conventions that arc important in 
language use. He used the participants in a conversation as his model. 
He noted that conversation is not random talk, that the participants in 
a conversation appear to be-engaged in a cooperative venture, such as 
trying to exchange information or opinions with each other* Grice for- 
malized this general point in what he called the "cooperative principle," 
which states that each participate both produces and comprehends 
each utterance in relation to whatever general purpose or direction 
holds for the conversation at that moment. The general principle can 
be broken down into several more specific maxims (we use Clark and 
Havilancrs|l977| restatements ofGrkc's maxims): (t) Quantity — Make 
your contribution no more and no less informative than is required; (2) 
Quality -Say only that which you both believe and have adequate evi- 
dence for; (3) Relation— Be relevant; (4) Manner— Make your contribu- 
tion easy to understand by avoiding ambiguity, obscurity, and prolix- 
ity* These maxims are useful for accounting for the way in which 
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meaning ii conveyed by if f r plication* Consider an example derived 
from Gritr: I'rrd i* standing alongside his car on a street and says to 
Mary, an approaching pedestrian, *l am out of gasoline* Mary replies, 
"Thrrrt a station around the corner.** "lite implied meaning of Mary's 
remark is that the station is a gasoline station, that it is currently open 
(or at least site believes it to be), that it is within easy walking distance, 
and so on. In other words, the force of her remark goes beyond its lit* 
cral meaning, and this force is intcrprctablc j n light of the "cooperative 
principle** and its specific maxims. 

Written Communication 

The idea of cooperation applies to all forms of linguistic com- 
munication. However, since " written communication differs from 
speech in many important ways, we need to describe the special nature 
of the writer- reader relationship and develop a list of conventions spe- 
cific to this case. Many scholars have noted that there are important dip 
Terences betweeij written and spoken communication (H'xich» 1977; 
Pratt, 1977; Ricoeur, 1976; Rubin, in press; Schallcrt, Klciman, and 
Rubin, 1977). Since there are many types of written and spoken com- 
munication (Rubin, in press), we need to be specific about what situa* 
tions we are referring to. We will consider two prototypical situations, 
facc-to-facc conversation for spoken language and simple texts like 
stories, essays, and articles for written language. Table 1 lists some of 
the differences we have derived from the sources referred to above. 
Most of these are based on the fact that the composition of a text and its 
comprehension occur at different points in space and time. As a result, 
texts do not allow for interactional give and take, and thus must be 
composed with deliberatcncss and care. The difficulty people have 
learning to write is often attributed to these differences (sec, for exam- 
ple, Hirsch, 1977). 

With the differences listed in Table I in mind, we can turn to an 
analysis of the nature of written communication. Figure 1 presents a 
schematization of the situation. The starting point is the writer, who 
has in mind a complex network of propositions that represent the com- 
plete message that is to be communicated via the text. A major con" 
vention of linguistic communication is that much of the intended mes- 
sage is transmitted by implication. The writer expects the text to inter- 
act with the reader's interpretive skills and general knowledge to pro- 
duce in the reader's mind something close to what is in the writer's 
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Table t. Characteristics of Writing Compared to Speech 



Dtunptu 



Permanence 

tfelar lament 

A hue nee of feedback 
Nouspeclfklly 

Tellabtfily 

Organ Izalkm 

Fonnstity 

■ Economy 

Greater precision 
aM detail " 

Greater complex lly 
and absf ratines* 
of subject matter 



Writing persists thrwffh Umet while speech is liigltly 



Both the conienl nnd form of written langiia£* is divorced 
from the immediate context in tmm and time. 

Writing ft a one-way process, without feedback. 

Writing n typically «ffcjr*s*cd to a generat audience lather f 
than a specific Individual. 

The topic of the text deserves the trouble involved in writing 
It up. 

Wfllten language h much more planned and organized than 
speech. 

The language of writing lends to be more format than 
speech. 

Written language has lets redundancy than spoken language. 

Written language can develop an idea, character, or setting 
In greater detail and with greater accuracy. 

Written language can develop much more complex ideas 
than apojrert language. 



mind. The writer*! task ii to select and organize a set of propositions to 
be included in the text that will be maximally effective i n leading \he 
reader to reconstruct the intended message. According to this model, 
there are fewer propotitiorit i n the text than there are in cither the writ' 
ct*s or the reader*! immediate representation of the text. 

How does the reader go beyond the text in constructing a repre- 
sentation of ilr intended message? This b one of the most basic issues in 
the psychology of reading comprehension. There are two general types 
or knowledge the reader uses. The first is general knowledge about the 
nature of the world and the events, actions, and objects that populate 
it. Research In both cognitive psychology aryJ in artificial intelligence 
has conclusively demonstrated that general knowledge plays an impor- 
tant role in understanding even simple sentences and texts. The second 
is knowledge about how textual transmission works. Writers select and 
organize propositions Tor inclusion in their text not only on the basis or 
what they think the readers know and what their specific purposes are, 
but in accordance with general principles or style and organization tliat 
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apply to the genre, such as essay, research report, or story. The render 
understands that the text was composed through a scries of deliberate 
choices on the writer's part, and the reader understands the conven- 
tions that governed these choices. Further^ the reader assumes that the 
writer had the reader's task in mind during composition, and was try- 
ing to make the reader's task (comprehension) possible, lite reader 
interprets the sentences of the text in accordance with these general 
beliefs about the writer-reader relationship. In essence, the task of the 
writer is to guide the reader through a plot, an argument, or some 
other discourse structure. The reader expects this guidance. Accord- 
ingly, we have chosen to call the overriding principle for written com- 
munication the "guidance principle." Written communication is 
planned, one-way* and noninteractivc» and the writer's role is to pro* 
vide an appropriately orchestrated set of clues about the intended mcs^ 
sage. The reader assumes the writer is acting in good faith in the role of 
guide. An effectively written text is one in which the reader is in fact 
guided toward (he reconstruction of the intended message. 
^ * Most of the recent research in cognitive psychology oti text 
understanding has used simple stories as materials. Thus, we will use 
such stories to illustrate what we mean by conventions of comprehen- 
sion and describe their effects on readers. Later we will describe com- 
parable phenomena for two nonaction genres, academic essays and 
magazine articles. 

A simple story is a story with a single focUs or plot that is told 
from a single point of view. Even simple stories have both underlying 
and surface levels of structure or organization. The Underlying struc- 
ture is an abstract representation of the information contained both 
implicitly and explicitly in the text of a story. Figure 2 presents a gen- 
eral representation of, story structure. There is a network of back* 
ground Information, called the Exposition, and the core of the story 
(the Narration) consisting of Complication and Resolution. Story 
grammars of the kind developed by Mandler and Johnson (1977), 
Rumelhart (1975, 1978), and Thorndyke (1977) codify the complexi- 
ties possible in the highly schematic structure shown in Figure % The 
text or surface structure of a story represents one embodiment uf the 
underlying structure. The writer has many options in transforming an 
underlying structure intoa text. First, the underlying structure is much 
more complete than the surface structure. Thus, different surface 
forms can vary in which propositions are selected. Among the factors 
that influence the selection are the writers assessment of what the 
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Figure 2. The Major Elements of Story Structure.. 

STORY 



EXPOSITION 




COMPLICATION RESOLUTION 



r^der knows and the writer's purpose in telling the story. Second, the 
order or elements in the surface structure can vary* Presumably the 
underlying structure of a story has its propositions in their tausa) or 
temporal order. However, the writer can choose to present events in 
any order at alt, as long as the underlying order can be reconstructed 
from the text. Similarly, though the Exposition is usually at the begin* 
ning t it can be delayed in a variety of ways (Sternberg, 1976). Third, 
specific versions of a story can vary in the point of view of the implied 
narrator, Scholes anti Kellogg (1966) differentiate narrative from drama 
by noting that the former consists of both a story and a storyteller, the 
latter only a story. The storyteller can be one of the characters in the 
story, narrating in either tint or third person, or he can be omniscient 
and uninvolved. Fourth, surface versions of the same story can vary in 
style, that is, in the selection of particular words, phrases, and sentence 
structures designed to create certain effects* 

Let us now examine the conventions of composition shown in 
Table 2, Many of them are self-explanatory, so we will provide only a 
cursory description here (a more complete description wilt appear in 
Olson, Mack, and DufTy, forthcoming). Although these conventions 
apply specifically to simple stories, we believe, they are similar to those 
for all simple texts, and we believe students can be. aided both in their 
writing and in their reading by knowing them. 

The first two conventions, purpose and mi^uetm** are quite gen- 
eral, and apply to most forms of communication. They are based on ' 
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Table 2. Conventions nl (inniposiliori for Simple Stories 



Contention 



tktoipttm 



|. 1*tirpn*e 



II. Uniqueness 



111, U mlt dying Oi gamrm km 



A + Focos 

ft. Overall Nan 

t. Coherence ' 

2, Completeness 

C. Representation 



tV. Surface Organization 
A. Omniscience 
B + Fein! of Vkw ' 
C. Segittcntation 

O. fUclcfennirtd , 

E, Orderly Flow 

F, Connectivity 



G, Economy 
11, SpecrfcHy 

I, Implication 



The wiiin h.it n por|m*c in imntl, mhU at I" 
tnifrrti, niwuitr. nrmsrnirl, 

l"he story rontnin* nnvH or itni<|iie rh-nitiir** evrn 
if it fiAUtwt a well-known ft*mti1a* 

ll*e IrM \n basal on an underlying, alrafr*H 
slrorlure thai t» well Tofmetl for llie parfirirhr 
grine; 

Tnere it one main line of development. 

llie dory has an oveiaH plan llial provnlrs well- 

formed oufcr to hi mcltfitlital prn|mftiftnirs* 
All actions, events » t or stale* are appropriately 

motivnietJ, eaosctt, or twAArtl, 
llie sfiuclure read* l» a resolution* wjlh all loose 

entKjtcd together. 
The work! of the leal h similar to* hut intentionally 

not kfenlkal with* the worM e»pcrientcd liy the 

reader. 

Toe writer has a plan lor presenting i|*e story. 
The writer fcnows att along how llie story will end 
llie story wiH be loM rnmt one point of view. 
The tlory in loM by means of specific scenes or 
episodes* * 

The writer wilt present sufficient background 

Information so that llie story ean lie umrer*lo«<l< 
The sentence of segment n ami propositions in ttie 

surface of the story h principled. 
The w riier wMl provide tunVknl ie»lital 

Information so that the reader ran make all lite 

necessary inferential connect Jons among ilie 

elements of Ihe story. 
Everything thai b presented has a purpose within 

Ihe aorlace plan of lite writer. 
The plot of a story b presented by means (if 

particular characters and events llwl are dinrrne 

in space and rime. 
Hie motivational or eausd structure ol llie story is 

conveyed by tmfAhmkm, 



GriceV principles that we described earlier. *Ihc books we exjtirrinrd on 
writing repeatedly pointed out liow important it is to liave a clear pur- 
pose in' mind, and' how oOcn poor writing is characterized toy the 
absence of clear purpose (for -example, see SltaUghnessy, 1*177). 
According to uniqueness, even though die write/ may be following * 

. - f ■ , 
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highly !iHHi-<Hy|iril Oii iiiiiln, there will In? unif|in- rlrinriils lo the- shuy 
lor in-line, r;nh munler myalt-ry ha* its new (Wists^ 

The ronvnttioits uf underlying organization oYkcril>e tltr exuv- 
iations *i tender linn ntxiut overall structure, and are biseil on (tie work 
fin story grammars. The convention uX focus is frvAninminl for ihe sini- 
plr Atone* we n r e considering. Overall plan Mates in an elementary way 
what ttie sjoj-y grammars have tried to rapture. The rcadelr expects all 
of the elements of the story to Tit into a coherent general framework, 
each element having its place in an overall plan and the entire plan 
having a clear resolution. The episodes of a story must be causally con- 
nected* but only those causally connected episodes in which conflict is 
created and resolved cat? be a story. The convention of rtprtttntolion has 
two parts. first, the reader expects the world of the story to be similar 
-to the world we know. Even within htgTily stylized genres like science 
fiction there are strong expectations of correspondence to reality along 
with the obvious conventional departures from it (Schofes and Rabktn, 
1977). Second, the reader also expects the world of the story to depart 
front reality in certain ways. The world of the siory is an idealized 
world, or in Thor nicy's ( 1976) words, *an artistically disciplined repre- 
sentation of life" (p. 39). Thus, it is expected that stones will have char- 
acters who are stereotyped or larger than life, and that the sequence of 
events will often be highly improbable, with too many coincidences. 
Unlike ihe real wodd, the conflict in a story builds rapidly and clearly, 
and is totally resolved at the end. In short, the world of stories is a con* 
ventional world, simitar to the real world in many important ways but 
also quite different from it. 

lite conventions of surface organization characterize the expec- 
tations a reader has about how the writer will tell the story. That of 
omniscience is a central one. The story is being tol<J by someone who 
knows how it will end, and therefore the reader assumes that each ele- 
ment that appears is parf of an orchestrated plan. This is the heart of 
ihe "guidance principled point of view is definitional for the simple 
genres we are considering. Only in complex short shories or in novels 
does one fii>d a story being developed from multiple points of view. Seg- 
mentation statc^jLbaf the story will be totd through a series of discrete 
units, in particular, through specific scenes or episodes that are sepa- 
rated in space oMime. This is a property that narratives and dramas 
share. The tradition of scene* in a play is a good illustration of the 
point. The convention of background asserts that everything needed to 
make the story understandable will either be apparent on the basis of 
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grnrral knowledge or will lie poividrd hy die writer, "Hinr ;nr nuiny 

tunvriitiuiitt fur presenting h;»<kg d iiilonnntmir A in rut mono 

graph hy Sternberg (I97B) desirihes and illustrate* m;niy of these, In 
very simple slorics, the background is usually presented at die hrgiii- 
ning. However, there i* the well known rnnveidiuii i>f in mfdim ret, 
where the story begins in the midst ofsjiecific actions and die necessary 
background is woven into the development of the pint. "Hiis would 
scent to he a more difficult form for both the writer and the reader, hut 
ii is often used. 

Orderly flow and connectivity are fundamental conventions of text 
processing, and have forced the heart of Ihe theory developed hy 
Kintsch (Kintsch and van L>ijk, 1971); Kintsch luid VijKJiid, l<17N). 
Each dement of the surface structure must be intcgiablc tutu the ilcvch 
oping network of propositions that represents the meaning of the text, > 
lite existence of well-known limits in immediate memory and attention 
suggest that propositions that cannot he immediately integrated will 
increase processing difficulty. Kintsch** model can be viewed as an 
explicit embodiment of these principles. 

Economy \* an extremely Important convention for stories. Read- 
ers expect that everything in a story is there for a reason. If a small 
detail is mentioned, especially in isolation from other details, readers 
expect.it ntay.be important. Of course, in stories suc h as murder niys* 
teries, attention to small details is elevated because of conventions asso- 
ciated with the genre. But ve have seen much evidence in our rcscmr h 
of readers paying special attention to details even where they are ulti- 
mately irrelevant. There is no conflict between this and the fan that 
details tend not lo be well remembered (Mnndler ami Johnson, 1977; 
Meyer, 1975; Thorndykc, 1977). Some derails may seem itnjiortant 
when they are first encountered in the story and may receive special 
attention even if they are not central to the final representation. As a 
rer'jlt, importance defined « » proposition's location in a story gram- 
mar hierarchy (see Thorndyke, 1977) may not covary with reading 
times in the same w*y that recall does. 

Specificity is a closely related convention. Readers expert stories 
to be told by means of specific, concrete events and thniaciers. The 
episodes that comprise die narration (sec Figure 2) most occur at a spe- 
cific time aild place, and the characters must be particular. Statements 
about general patterns of events or the disproportional prn|K-rtir* of 
character* arc elements of the batkgmuitd. Steinberg (1978) !ins 
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rlr*€ lilwd how tlir contrast between particular events and summaries or 
p* : ir actions, air mnl 1q differentiate narration from exposition. Our 
evidence indicates that readers arc quite sensitive to this contrast. 

Implication slates that certain classes or information trnd to be 
conveyed indirectly. |n simple stories, the motive or causes of actions 
or events are almost never seated explicitly. The motivational structure 
of events in a story must be supplied by the reader. Interestingly, story 
grammars typically make this information explicit, supporting the view 
that tfoey are best seen as descriptions of underlying structure. 

Applications ami Generalizations of the Conventions 

In Olson, Mack, and puffy (forthcoming) we describe in detail 
how the conventions in Table 2 relate to the strategics readers use in 
understanding simple stories. We have studied these strategies by 
examining a number of reader behaviors, especially the time taken to 
read each sentence m a text by subjects who are reading silently and the 
protocols provided by other readers who are asked to talk out loud 
while reading the text. We have studied the processing of both well- 
formed and ill-formed texts, and have verified that readers use knowl- 
edge of the conventions shown in Table 2 to guide their comprehension 
behavior. In reading a well-formed story, the reader generates hypoth- 
eses about the plot during the exposition, and then uses these — in con- 
junction with the conventions — to determine which sentences are most 
important and informative. When reading silently the reader devotes 
more time to these sentences, presumably to draw inferences and con- 
struct a coherent representation of the story. In ill-formed stories, 
which violate various of the conventions, comprehension is disrupted 
and readers are often misled or confused because their expectations 
about how the story ought to be told are violated. For instance, in Bart- 
left's (1932) famous "War of the Ghosts," readers have considerable dif- 
ficulty constructing causal links between the individual episodes that 
follow each other in time (see Mandler and Johnson, 1977), and are 
unable to generate coherent hypotheses to guide their sentence by sen- 
tence comprehension of the text. By contrasting well-formed and in- 
formed stories, we have been able to conclude that an important com- 
ponent of text readability is the extent to which general principles of the 
type shown in Tabled are followed (sec Olson, Mack, and Duffy, 
forthcoming). 
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Conventions ol Non fiction Forms 

Kdncatcd readers (collrgc subjects, for example) pmscas knuwl* 
edge of the permissible underlying structures and the conventions of 
surface forms for simple stork*, and this knowledge appears to influ- 
ence their processing. Is tins also true for other forms of writing such as 
tlte academic essay and the popular magazine article? On the basis of 
our examination of "how -to- write* books, the conventions of writing for 
these forms are clearly quite different from stories, but they &p|>car to 
be just as well defined. Educated headers who' know something about 
the conventions of composition for these forms use this knowledge dur* 
ing comprehension. 

The Aeadcmle Et say. Both the academic essay ami the maga- 
zine article are simple in the same' way that the stories we have studied 
are simple: they have a single focus or line of development and they are 
written from a single point of view. The academic essny is the form 
most frequently encountered in books on rhetoric and in classes on 
expository writing. It up written in order to persuade the reader of the 
1 correctness of a thesis. The organization of the essay is looted >n the 
format conventions of argumentation, and it is usually written with a 
thoughtful, serious reader in mind. 

* Books on rhetoric devote considerable attention to the undcily- 
ing forms of argument an essay might employ. A deductive argument 
t tart* with an initial set of premises and supports the thesis through a 
series of intermediate deductions. Each step in the argument must be 
well formed according to the principles of logic. An inductive argument 
is one where the thesis is supported by a series of particular pieces of 
evidence, with each piece contributing general support for the thesis 
but none guaranteeing it. The underlying structuie of an essay would 
be a canonical representation of the arguments developed in support of 
the thesis. Just as with a story, the dements of the argument can be 
embodied in more than one surface form. For example, a deductive 
argument has a natural order that starts with the initial premises and 
works its way toward the final conclusion via the intermediate deduc- 
tions, but such an argument can be presented in various ways. Hie 
location of the conclusion or the thesis it one common source of varia- 
tion: possibly at the outset, so the reader can have ft in mind through- 
out the details of the argument; but possibly withheld until the end, 
particularly if the conclusion is unacceptable, controversial, surprising, 
or humorous. There are also conventions about which parts of tlie 
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deductive argument arc made explicit, including the cntkymrmr, asyllo- 
gistn whose major premise is implied, and die sorites, a chain of syllo- 
gism* in which rmly the final conclusion and the intermediate minor 
premises arc stated explicitly. Most deductive arguments that appear 
in essays are enthymematit, and thus it is not surprising to find the 
cnthyineine and the sorites discussed in books on rhetoric (sec Brandt, 
1970). 

Tlic strength of an inductive argument depends critically not 
only on tlic kind and amount of evidence (nit on its selection and order- 
ing. That evidence whicfrbest supports the conclusion or is most rep re* 
tentative of other evidence is clearly what the writer wants to select, 
and most authorities agree that the most persuasive ordering is to put 
the very strongest piece at the end. However, there are various ways to 
arrange the remaining pieces. The climactic order builds from the weak- 
est evidence to the strongest, while the Ntstorian order starts with the 
second strongest piece and then builds from the weakest to the strong- 
est (Hughes and Duhamcl, 1962). 

The essay has much in common with the story, and the conven- 
tions in Table 2 can easily be modified to describe the principles of 
composition for essays. As in the story, the reader is using ihc text to 
try to extract the underlying structure, which in the case of an essay is 
an argument that focuses on a single thesis. The greatest difference* 
would probably arise in the principles of surface organization. As one 
illustration, we pointed out that it is important for the Narration of a 
story to be told in specifics rather than generalities (specificity). This is 
because a story is about a specific set of characters interacting in spe- 
cific locations at specific times. An essay, on the other hand, is written 
in a mixture of specific and general statements (Young, Becker, and 
Ptke, 1970). 

1 The Magazine Article* This mpch more heterogeneous class of 
prose forms than cither the story or the essay is of interest because sev* 
cral authorities (Brandt, 1970; Dillon, 1977) observe that it is com- 
prised of a blend of story and essay techniques. The magazine article is 
often written to inform or to persuade, but it must also entertain or 
interest the reader. The situations in which they are usually read are 
informal or casual, occasions when the reader does not want to engage 
tn heavy intellectual work: in waiting rooms, on buses and planes, dur* 
ing lunch, in the bathroom, or relaxing on the sofa. As a result, the typ- 
ical magazine article is much less formal than an essay, and the princi- 
ples of composition are quite different. 

5<J 
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Just like any other coherent text, an article ban a beginning, a 
body, and a conclusion. Hut these parts arc composed of a number of 
elements that arc relatively unique to magazine writing (sec hrandt, 
1970; Dillon, I977; Guntlicr, 1976). The article begins with a had, a 
provocative or interesting anecdote or vignette designed to capture die 
reader's interest. The theme is usually stated shortly after the lead, but 
the relation of tire tticmc to the rest of tlic article is not as tight as the 
relation of the thesis to an essay, lite article often achieves focus by 
claiming to prove a point (Cunthcr, 1976), but the body or "proof of 
the article at most illustrate* or alludes to the point rather than present* 
ing a logical argument for it. Brandt (1970), in characterizing reporto- 
rial writing, claims that the writer selects and organizes facts and gen- 
eralizations in order to convey a perspective, but does not present a 
tightly structured argument. Coherence is achieved through 'pseudo 
connections" between subordinate elements. This is the art of using 
various devices to create the illusion of the temporal connectedness of a 
narrative account or the logical development appropriate to demon- 
. stating a diesis. One such device is to essentially list subtopics that 
could be relevant to the writer's point, as though the writer were going 
to develop the connections, but where in fact they are merely "called to 
mind* as illustrations of some point. Cunthcr (1976) describes simitar 
devices, wrjjch he calls the "flash-by* and the "string-of-pearls* tech- 
niques in his influential practical guide on article Writing. An article 
usually ends wtdi another example or anecdote of the type used in the 
lead. Article writers are advised to achieve closure, to leave the reader 
feeling satisfied. But exactly what this means is harder to define for the 
article, which lacks the clear conflict resolution of the story or the logi- 
cal coherence of the essay. Cunthcr (1976) sums up the approach to 
article writing by stating that the most important step, is coming up 
with the right "slant" or "angle" for presenting the article ^content. 

Articles in popular magazines often use elements of Actional 
writing. People, places, and events are sketched through anecdotes, 
vignettes, and quotes. The writer selects and organizes particulars in 
order to produce drama, surprise, suspense, or provocation. Generali- 
zations are continually interwoven with narrative-like elements about 
people, and the motivations and reactions they exhibit. In other words, 
the writer simulates a narrative account that somehow conveys the 
point without presenting a carefully reasoned argument demonstrating 
it. Thus Dillon (1977) refers to the magazine article as a noiiflctton 
story. 
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The "hnw-kV books on article writing give considerable atten- 
tion to ihr tonvciiliniisofthis genre, antt readers who have wide exper- 
ience with magazine articles probably hnvc some expectations about 
what ihey will find that are quite different than for stories or essays. 
Itoth nfllte latter forms have clear underlying structures, and the read- 
er's main lank is to extract these? structures front the text the wrijer has 
prnvulcd. But we would not expeet article readers to be trying to 
exlraet an underlying organization be adopt the hypothesis* testing 
mode that we have seen so clearly in our story research. 

Conclusion j 

In this chapter we have presented an analysis of the relation 
between the writer and ihe reader of prose, and have used this analysts 
to describe some of the reader's steategies in comprehension. Most of 
nur analysis has focused on the reader. Howcvcc, we feel our work has 
important implications for the analysis of texts and for the writer All of 
us share the intuition that texts vary in how easy Ihey are to read. 
Many investigatorfehave attempted to develop objective indices of text 
readability. Such indices would be' useful in assessing the comprehen- 
sion difficulties of reader* and the composition difficulties of writers. 
Moat readability indices, however, have been based on lexical or syn- 
tactic properties of text, and most have been only marginally useful 
(Kintsch end Vipond, I97tt). Recently, Kintsch (Kintsch and van Dijk, 
1978; Kintsch and Vipond, J978) has proposed that the most useful 
indices of readability will be those that are based on a processing 
model of the reader's behavior. This sensible suggestion has some 
interesting implications. Perhaps the most important one is that 
readability becomes a joint function of the text and the reader, rather 
than being a function merely of the text. Some texts will be readable to 
almost everyone, and others for almost no one. But most texts will be 
differentially readable to individuals who vary in their specific substan- 
tive knowledge, knowledge of the conventions of various genres, par- 
ticutac reading skills, and general information -processing abilities. In 
support of this, Kintsch and Vipond (1978) have demonstrated how the 
readability of texts varies when they make different assumptions in 
their processing model about how much information (in the form of 
propositions) can be processed at one time, and how much can be held 
in immediate memory. Our research suggests that readability also 
varies with the writer's use of the conventions of writing. Thus our 



work dinulcl coiilribtitc to the dcvrlopniciil of psychologically mean- 
ingful indices of readability. 

Hie conventions listed in Table 2 arc known by l»>tli the reader 
and the writer. Therefore, our analysis ought to have Mimclliing to say 
about die process of writing. Up to now, there has been very litllc work 
dnrte on the cognitive psychology nf writing (some examples are Bruce 
and others, in press; Flower and Hayes, 1977). Most scholars divide 
the processes of writing into two broad categories, one associated with 
generating ideas and the othec with putting the ideas into words. Our 
research on the principles ofcomposition is relevant to the second cate- 
gory. Howevec, what we need to do is to study the behavior of writers 
to see if we are really on the right track. Initially we might carefully 
examine the prose of writers who are at varying levels of proficiency, as 
well as examine successive drafts or a paper by reasonably skillful 
writers. 

There is also an indirect way in which ouc analysis bears upon 
writing. It is widely believed that good reading and good writing go 
hand in hand. Good writers tend to do a lot of reading, and learning to 
♦read well seems to be an important component in learning to write well 
(Haynes, 1978). Our analysis is directed at making explicit the con- 
ventions ofcomposition that are known to the skilled reader. If further 
research confirms ouc impression that this kind of knowledge is one 
component of effective reading, then explicit consideration of such 
knowledge in classes on writing might be useful for the learning writer. 
Further, a deeper understanding of the processes involved in prose 
comprehension and how these processes relate to composition might be 
a key to the crucial writing skill of self-criticism. The writer who can 
most successfully discover what Is wrong wilh a particular draft of a 
manuscript ought to have the best chance of improving it in a revision. 
The principles we have proposed, and the techniques we have explored 
for Identifying them, may prove to be useful tools for developing 
instructional methods aimed at acquiring these skills. 
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t DCNITIVC ASPECTS OF GENRE * 



CARY M. OLSON. ROBERT L. MACK and SUSAN A. DUFrY 



Reedeis and wlitei* communicate vk « te*i wllh the aid oT t number of general and tpeclffc 
atnvenlfcni. In lhf* paper (he geneial convention? governing written communicilfcn ate 
ile*trlbed, tnd their arrlloitmn to two Important genre, iioikt and euayt, b analysed. Data 
horn subjects talking out loud whlk reading b used to obtain Information about the knowledge 
iml aliategkt -readers employ while leading tlJlpk te*it. Reading timet eolkcted fiotn othet 
luhjecla reading the tame te*ta silently b used a* converging evidence Tot evaluating the talking* 
nut loud data. A numbef or slmiatltfct and difference* In the proteasing or stories and essays 
aie teviewed. Sloi* tetdei* have an essentially prospective orknlsllon, geneiallng predictions 
incf looking ahead to what b coming up. In contrast, readers of em y* approach Che sentence* 
by lenience pmceising mnte reliospeclUetyt fitting Ihe cut fen* sentence In with earlkr Inrof* 
nation 'hat had been explkliir piesenled m the leaf. 



It takes many lypes or knowledge to be a skillful reader. Recently, w e have been 
examining how knowledge or Ihe conventions or writing affects the comprehension 
activities or college readers (Obon tttl l9B0;0lsonef al In preparation). Commu- 
nication or inrof matron via written text b a specialized activity, and tt b hardly sur* 
prblng thai a considerable amount or special knowledge woutd have to be acquired 
iu order lo be either an effective writer or reader. Our research has roccssed on ihe 
lynes or knowledge skilled readers use while reading simple texts. In thb paper we 
will examine ihe knowledge readers possess Tor two types ortexts, namely, simple 
storks and essays oT Ihe type round in ekmentary rhetoric texts. Our basic claim 
is that skilled readers possess knowledge about Hie forms of these texts and their 
principles or composition, and that Ihey use thb knowledge during the process or 
undemanding. We will describe Ihe kind or knowledge college readers possess, and 
illustrate How they use il while reading. We. will draw our data from a series or 
shidJes we have conducted using a variety or texts and tasks. 

The atticle will be organized as follows. First, we will provide a general concep- 
tual background ror Ihe lype of analysis we have developed for text processing. As 

* The wmfc descilhed hetewas made posslbk by a icse*ich grant from (he National Initlluieof 
Kducailon tNlt^G 79-01 JJ> and b]L a Reseiich Cafcei De*eM«iWnl Award T*om NKllD 
(5K04 1 1 DOTH 69) awaided lo the senior author. 

Rtqueii? tor reprint* iff InTormatlon thoutd be addiewd to: Gary M. Olaon, hep<. of P*y* 
chotr^y, UnJwtWyofMlcm>an,3J0Pacl!aid Road, Ann Aibor, Ml 48104, USA. m 
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mil tif this background we will spell out uur ideas on how cDiiiinuuicaliou viu 
vrlllen lexis woik. Second, wc will briefly describe I lie Iwogciues wc havcinvcsll* 
;aled. simple storks ami academic essays, picseuting a scl of defining characlcrfellcs 
ur eacli. Tliinl. we will deserve llie various tasks we have used lo sludy the know* 
edge and pr occsslw* strategies employed hy skilled rcailers. Fmirlli. we wJW prescnl 
■ sample of uttr finding Tor I lie two genres In imeslioti. Finally, we will discuss Hie 
nore general issue or knowledge or genre conventions as a component ofwlmt tlie 
kJlletl reader must team, 



'oneeplual background . 

"hough we usually j 0 nor think ur II in tlib way* communication via writing is a 
oclal process. Two peuple are Interacting with each other, under lite special ctindi* 
Ion thai Ihey are not at lite same place al Hie saute time. However, Ihey are or 
lecesslly very much aware or each other. The effective writer must constantly have 
lie reader in mind In order to produce a text thai will have Ihe desired effect, SImi- 
arlyttihe sklfted reader roust be aware or Ihe author's inletilJmis, Gotnl wrlllng 

* eptesetits a ikillrul selection and Integration or material which, when combined 
villi Ihe reader's knowledge and strategies, leads to the outcome Intended hy Ihe 
vriler. Similarly, the reader, is part or what he or she needs | 0 know in order tn 
ead Ihe tex1»musl understand hollr Ihe writer's *oaIs or Intertlkins and Ihe specific 
Irategles used hy the writer lo select and arrange Ihe tratertatm Ihe text llnth the 
vrher ami the reader understand lhal ttte text represents a specially selected and 
■rranged set of propositions wlitcli will) In conjunction with Ihe reader's knowledge, 

* Hoducean approximation or the writer's Intended message In Hie reader's mind. 

In order to develop a model or how Ihe writer aitd reader Interact Uiroitgh a 
ext, Il Is useful lo consider sonic of the ways In which written coniinunicalJuii dir- 
er* from speech. White ipeeeh and writing have titatty shn&arH ies, atid listeners and 
eaders obviously employ many common processes and types ofknowledge during 
xnnprehemlon, there are atso some Important differences that make the task in" 
eading somewhat different. Many scholars have commented on these dJrrereiicea 
Illrscli 1977; Pratt l977;Rlcoeur 1976; Sclrallert ef at 1977; Rtrbj|^49gO), 
jince Utere are ciiany types or written and spoken cor m mini cat km (KubJrr 1980), 
ve need to be specific about what slluatlutis we are rearing to. We will consider 
wo prototypical situations: facc*lnTace conversation Tor srniken language and rim* 
- ile texts like stories or essays Tor written language. Table I lists some ortlte differ* 
:nces we have derived from the sources rererred to above. Most of these are based 
mi the Tact that the composition oratext and Its ciimprebenslori occur at different 
joints In space and time. As a resoll, texts do not allow rorinter actional gjvc and 
ake and tints must be composed wJHi tlctiberaleness and care. A properly com- 
msed text is ait urganbedt cojii|ilete structuret winked out as a whole with an over* 
ill plan or purpose in mind. All of Its parts serve some pnrptise.ralse slatts.errins. 
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and OlIiCl i uendcs have been eliminated. I\ach sentence advances (he Icxl 
Iowa id a point ufdimne, umlei Hie plan of Ilie author. Relevant baclcgioimd infoi* 

mal inn for the intended audience id the IcmI Is included If it ca I be inlcitc J + The 

wiilei, if a good one, has taken souuMioohlc In try to anticipate what Hie leailef 
will occd In know, anil has inch iJc J what would ntri he obvious. In short, I he lent 
iiiusl stand mi its own. fly ihe same token, because it It compose! deliberately ami 
i ncfnlly, ll has a fluency noC found in couvcjsalloii* ft I* moie formal* These many 
tliffcrcuccs between speech and wilting arc major sources tif difficulty foi people 
learning hi wi he (<*,£.. Iliisch 1977). 

Ut ns now turn mir attention to an analysis of the nature of wiltlen communis 
culion. As noted before, theie aie certainly many similarities between reading and 
likening, ami a mmibei of the points we will make will be common to both types 
or comprehension. Ilowevei, with the differences In table I In nihtd, we will also 
note some aspects or lent pmcessltig that differentiate it from listening. Tig. I pie- 
«enls a scliemallTatitiii or the situation. The slatting Twhit is the wrllei.wlic has In 
mind a t'omple* network or propositions Ilia* lepreseut the complete message that 

is to he co ricaled via the text. A inajm convention or linguistic comnmnica* 

lion is that much or Ihe Intended message Is liansmtlled by implication. The witter 
expects the text to hiteiacl with the reader's Inteipretlve skills and general know 
ledge lo imidnce hi the reader's miud something close to what is in the wiiler's 

* 

tablet 

< haracicrlulct of willing tnutpared tn ipctch. 

< haul leilttlc Oefttilpilnn 



t frrunnenrc Wfiilnp prrrisir thrniuth time, while speech U highly 

2. ncrncluiienl . ^ Holh ihe content and farm of wiiuen language k 

t divorced from the immediate ct>n«xr Jo *pa« 

and lime 

t, Ali^nre nf feedback , Willing Is i one-way pntcess. wllhoui feedback* 

4. - Nonipctlfhlly Wrliln* is lypfcifty addressed lo a gene I J audience 

father than a specific Individual, 

5. Fcrhhilitr Mtt topic of the deserves io have the trouble 

laken tn write M t*t>* 

6. I fcpaotraiitin Wilttcn language Is much in<»ie planned ami nrga- 

* nlieri ihan speeeh. 

7. I ormalliy 1 he language „f writing fends lo be more formal 

s lhan speech. 

R. I crummy Written language ha* (cm redundancy lhan spoken 

language^ 

9. Greater prr< Hlcro ?nd detail Written bngtiage ran develop a Inpk In greatel 

fleiall 

in fitcaier conipk^liy and Written language c*n develop mmc eonipk* Mua», 

ahttiatiitet* nf urfiject matter 
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miml. The wiiici's lask Is lo sclecl ami* organize a set of pioposllions tn he intituled 
In the text Hint will tie maximally effective In leading the leader to rccoiislmcl the 
Intended message. The reader* task, obviously, b to use the test to rcconsiiuct (lie 
writers Intended message* According In HiU iimftel, there are fewer piO|iosiliiiiis In 

(he text than there are In ellliei the wi|iei*s tn the reader's U edMte lepresenl^ 

tit m of the texl * 

I low dnes Hie leaner pi heyorid Ihe lext hi ctmittitictiiig a ie|ireseiilalion nfils 
hilemled message 7 Thb Is one of the imist hasjc bsnes hi Ihe psychology of leading 
turn prehension. In essence, the readei engages in a specks of pniMcin stdving/lhe 
inject of reading h to umleistand the intended message of the wiiiei* The rcmlci 
uses the text as data from which to generate hypotheses about what the text b 
about. The data from the text are evaluated with lespect to knowledge the readei 
brings to the situation. This knowledge helps the reader to stnielure lhe text, 
though many texts also have explicit guidance In them about their striictmc. Infer^ 
ehces and elabtiratloiit are drawn from the data In the text. While actually reading 
tlie readei generates predictions about bolh Hie coulenl and Ihe slruduie id what fct 
yet lo come In the text, 

Theie are two geneial ty|ies of knowledge the leadei uses to engage hi lliese 
activities. The first b geneial knowledge about the nature of the woild and lliftcmi 
ceptualNtloiis about the work! that have been formed as a result nf prior c*peri* 
ence. Many KlfoTanThave developed theories about the lole of knowledge, In pro- 
cessing external Inputs, and have Introduced concepts like schemata, fiames, scripts, 
and MOPS (Oartlett 1932; Ha get l952;Mluslcy 1975 ;Scliank and Ahelstm 1977; 
Rumelhart atid Ortoiiy 1977; Schank 1979). Tluiugh theie ai^ tuauy tlirfereuces in 
deUil among these coucepls, Ihere b no cjtiesltou tlial concepts IWte Ihesc aie 
needed to account for language processing. Research In both Cognitive fisycliology 
(e& t RrvusTord and Jolmson 1973; Doollng and Christlaansen l977i llnwer rf at 
1979) and hiarliflclal Intelligence Wluograd 1972;Scliauk and Abelsoo 1*>77| 
has conclusively demonstrated dial general knowledge pbysan ln^nnlaiir role In 
under standing even simple sentences and texts^Becaose we know so much about 
the world we can understand elliptic refeieoccs tn what we know. 
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I he second 1y|*c nl knowledge uftri li y llie leader in jthoiil how textual tfansmb* 
shm wmks. 1 lie willei selects and mganUes |ir<i|HiMlMiins for inchishm In i text nn 
Hie basis uf whal Iw ihhiks lite reader knows and what hb specific purposes are, | n 
:Kcoul;nic#vJlh genera) principles nf style and organl/allon iliaf apply In the genie. 
Ihe reader imdetstamli Hint lite text was cinnposed thmtigli a series of deliberate 
clmlccs on lite writer's pail* and the reader understands I lie conventions thai gov- 
eiiieil Hiese clmlces, further, ihe reader assumes lhat Hie writer liad Hie teailerli 
task In mind tlmtiig the composition, mtd was trying In moke Hie reader's task (f.<., 
tompreheiislmi) possible. The reader, InierpretsJthe sentences uf the lent In accor- 
dance with these general hellers abuut the wikei -reader retail unship. In essence* 
Ihc lask uf Hie write? It hi guide the reader through a phi, an argument, of some 
other discourse s»ruclure, Tlie reader expects this guidance. Acci fdlngly. we have 
clmsen In call Ihe overriding principle Tor wfitlen communication Hie Guidance 
dlnclple. Written coniniuiilcatlun b planned, one-way. am) non-Interactive In real 
Ihlie, and ihe write?** role is to provide an apptopi lately urcheslraled set uf clues 
about ihe Intended message. The read*? assumes the willei Is acting in good faith 
in live Kile of guide. An effectively wfllten text b une hi which ihe teadei Is In fad 
unfiled toward Hie reconstruction nftbe intended message. 



Prhielplcsof text composition 

Wc now want lo describe a sel of pilnclples of composition that appeal It*, be under 
slcioil by writers and readers of simple stories. These prhclplet aie Intended to 
describe Hie general properties of simple lextt of the kind we hive studied In out 
lahuratory. Specifically, we have examined simple stoiks and academic essays, Foi 
technical feasors we have confined out attention to slories and essays ihat are no 
iiKif e than GO sentences Inng. Thb means that all | he stories we have looked >t aie 
dtnwn ftmn the fables, folktales, am) children's stories thai aie typically Investl' 
gated hy researchers interested In *toiy processing. They all have a single focus or 
plot ihat Is lold from a single point of view. Similarly, ihe academic essays we have 
used were taken frnin books on rhetoric. They all attempt to prove a Ihesb, make a 
com par isuu. or olherwbe Illustrate a single point. We feel that many elements of 
out analysis will generalize tu a wider range of texts and text types, am) will return 
to ihis pcilul at the end uf llils article. 

The principles we are about to present are Intended to capture the general con- 
ventions abuut the composition of simple te\ts that are part uf what a knowledge- 
able writer ami reader knows. Though we Initially developed principles like these 
for the specific genres nf stories and essays, we found enough commonality to be 
able to construct this irtore general list. Later we will Illustrate how these general 
principles apply to each of these two genres. Our central claim In thb paper Is that 
kiiuwtcdge of these principles plays a role In comprehension. Presumably It alsu 
plays a role in composition, though we are only just beginning work on I be wrller. 




tt Is likely that the principles altout to he ilcscr U131I also play a mle in training the 
spccllic i-oiivciilioiis uf a new genre, a slliiiitlim wc have mil examined al all. 

Tin? principle* have heen developed mi the bash uf two broad cfcisscs of rvj 
deuce. Hist, wc surveyed the llteiatme mi story ami essay wilting, examining Hie, 
advice given tu wrlleis about hoiv to |int a tcxl together, Wc have also read mono- 
gratis on the struclme of various |ifnsc fmms, Second, we have collected seveial 
Mmls uf dala for bnlh sturlcs ami essays. Some subjects lead these texts sentence* 
hy sentence ami talked utit hind, slating any Inferences, clalioiathins. predict Inns. 
Interconnections, or uther comments they fell compelled hi make. Since the lexis 
we used Included both good and had ones, we obtained much useful InfoimathHi 
abuut what leadeia expect In srorks ami essays and Imw ihb alfecls thch niii- 
ccsslng. Other subjects tead llvese same texts seulenceJiy*senteiice ihi a computet 
screen airJ we timed their silent reading. We have also collected iccall data ami 
ratings of proposition I hnpcirtaiice for each 1exl v Atl of thesp tasks will be 
described In inure detail later. 

Prior lo presenting tin? I hi uf principles II b necessary tu make explicit adbthtc 
lion that was Implicit In out earlier discussion, A text has both an underlying slrac- 
Uue and a surface stiuclnre. Hie underfymg structure a anatislract representation 
^ f Ihe htfotmatloii contained both Implicitly and explicitly In the text. 1\ach lexl 
type or genre lias a set of principles describing acceptable underlying slriiclmes. 1-or 
example, for simple stories* graiumars uf the type desciPbed by Runwlhart (1075. 
1978). Tlmrndyke (1977). and Mandler and Johnson (1977) ar?1>est viewed as 
descriptions of possible underlying structures (Julmsuii ami Mandler 1980, have 
specifically developed thb vfew^Laler we will describe possible underlying struc* 
lores fur academic essays. , L 

The underlying structure of a text Is an abstract description of tts essential fiirm. 
The surface structure represents one embodiment uf tlw underlying structure. The 
writer has many optluns In traiisfurming an tmdeilyhtg struct me Into a surface tcxl , 
lu fact, a given underlying structure can be transformed Into many dtffeicnt surface 
texts. These surface texts can vary In a number of ways, Hrst* they can vary In the 
way hi which propositions are made^ explicit. The underlying structure ts much 
more complete than Ihe surface structure, Tims, different smface forms can vary hi 

which propositions are selected. Ai g lite factorsthal Innucucc the selection aie 

I be writer's assessment of wtoftwe reader knows and ihe writer's purpose hi writing 
Ihe texh Second, the nrder of etemeots In the stirface structure can vary, WbHc the 
iiiKlcrlyhig structure of a text niay have a spcclfk causal, lehi|Hira1,or lugfcaloriter. 
the writer can cbmnc lo present the propf^itious of the text In any imler at all. as 
long as llie nuclei tying order can be reconstructed from the text. Third, specific vcr 
slims of a text can vary | n style, that b, In the selection of particular wimls, tilirascs, 
and sentence structures designed to cieatc s|»cciflc effects, Kiioith, certain lexis 
permit variation In nibcr facturs. l : or hislance, stories can vaiy In Hie |toioi of view 
nf llw hu|4led narrator. Scholes ami Kellogg |196T») iljffcieriilaie wrwihv Ifom 
ifratna hy Holing thai Hie hunter cmtskts of 1Mb a slory ami a slory-leller. wliili* 
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iUv bile/ inily lit a slnry, I lie jlory idler tan he one of t lie characters ill 

the tftny, iKir lalliif* in either lint n lhinl+|>crsim, or lie can he Isiienl ami irnih 

Vt ilvc<|. 

I et ns now rxamine Hie sel of principles sh»»wn hi lahle 2. Many or ihem aic 
vlf explanatory, so we will prrvide only a cilrsoly description here. Keep in mind 
Ihal ihcy appjy specilically In simple texts of the ly|>c wc have heen studying* 
I ;itei we will dhtnss how Ihcy translate into Ihe Iwo genres wc have heen Invesli- 
filing* simple sloiies and academic essays, 

I lie liisl Iwo principles, ftjr/fcHr am) flafomc ttf rjoir/ am/ fmniUar clcmatts* 
9iv tpiiie geneial, and apply to most forms of conmuinicaliim. Ooi>ks on writing 
icpeiitedly pnhil mil how Important it h for the writei to have a clear purpose in 
mini), ami how oflen poor writing is characterized by the absence of a clear purpose 
(r.jr, Shanghncssy \ l )71). Ac ci ml ing to 11a tat uc ttf novel aikt familkr Wcrirrrjfs, 
rven thotrgb life writer may he folhiwlnga highly stereotyped formula, there will be 
mrw|iie elements, Rut the newness riursl he blended with familiar elements. A text 
works by hoilding the new upon Ihe foundation of the ok), tafei we will demon 
si liit e the lm|mitance of these general principles for the corn pre I reus! on uf simple 
icxts 

Ihe principles nf underlying organization describe the expectations a reader has 
about timall stiircinre 1 * The writer b trying fo embody tu; unde dying structure in 
an effeclive surface text. The reader ts mainly trying to reconstruct Hie underlying 
stimime. The principle of foatx is defmllhmat for the simple texts we are con- 
sidering OreraU ftfan slales in air elementary way the essence nf wliat we mean by 
underlying structure. The reader expects all nf Hie elements of a text to fit Into a 
ctiFierenl general framework, each element having its place in an overall plan and 
the emire plan having a closed or optimal structure. The principle of CouvmtUmat 
uorht has ivm nails. Tint, it is expected that the world oflhe text will be similar to 
ihe world we know. Even within highly stylized narrative genres like science fiction 
or highly abstract essays theie are still strong expectations ofsome degtee of corre- 
spondence to the world we know fmm experience. However, it is also expected that 
there will he systematic, cnrivenlhma] departures from the world of our experience. 
Foi instance* Ihe world nf stones is an Idealized world, or In Thornley s words, "an 
arlisncally disciplined representation of life** ( 1976: 59) + Tlurs. it is expected that 
stories will have characters who are stereotyped nr larger than lire, and that ttie 
se. I tie dee of events will often be highly Improbable, wllh loo many coincidences. 
Unlike the real Wrld. the conflict in a story builds rapidly and clearly, and is^ 
totally resolved at the end. tn short. Ihe work) of stories is a conventional world, 
slmilai to Ihe real world in many important ways but also quite different ftotn it. 
Similarly, whh essays, a Int nf abstraction and idealisation Is Involved In putting 
together an argument or defending some general thesis. Yet it Is essential lhat there 
he correspondences l» the real world, or else the argument will be devoid of mean- 
ing, 

The principles ol surface organization characterize llie conventions that govern 
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u l onvenllnnt of ciuupmlllon for simple leiK 



X'miwnltblt 
I . Purpose 

1. Ibbnce nf niivefand faioirbr 
ekmenia 
A + t-aintfbrMr 

II. Nuvrlly 
y Undrftlylng organ Ira lion 



A* horn* 

ft. rhrepltpTan 

fD Coherence 

til) Cnmpleieneai 

C Convtnilunal world 

4, Surface ortanlulhw 

A. Onintftkmft 

B. Audknee 
t\ Scaffolding 



\h Segmentation 
Cnnrweifrliy 



t : . F.eunomy 

4 

a Olderly flow 

II. Ungmge 

<l> Signalling 

rll> Level 
I. rknrr tpedrk convention* 



liencl Ipltnn 

the writer ha» iiiw or inure \vtti\k piii|iii*ra In mint* 
The rest ton lain* a balance nf faiitllbr and nnvel 
ekmenK. 

The ImI inafcrrrnnlarl wllli Ibing* Ihe itidrt fcnuw* 

aboul. ^ 
tht it ti rnnlaim new or JhliiKlKr rkntrnlr 
Kit lexl ti bawtl i>n in umlrrlplnt ilruUmr Ifial is 

appr^piblr tnJ writ rurntctt tm Hit pailkulai 

Jt^nre 

1 hert ti nnt main line ^r drvrliipiiicnL 

rhrrr It an u^rall plan Itial prnviJn * wtl| ^rntcil 

mgsntrjtlkin fni Ihe ftfopt«lihin» nt ihe le*l. 
I Jth InJrvMtial profHix|lr<in fill tn a urdkii dried 

way Inin I Ik general plan. 
The overall *>rjt*ftl2allnn lui a doited or optimal 

flri»clure> 

The ir«t I kbawd on • world Ihal It tlmibr bnl mil 

Idenltcal lo llie real world, 
tlie wtlltf hat a fttrtace plan fur prnenMng Ihe 

surface proposlllnm ur llw Itil 
Al any point tn ihe le*i ihe wilier fcrtowi where ii 

tt going, 

The lent Ii writkn wilh an andknee hi in hid. 
The ferlltf pre$enli enm^gh supporting nialetbl In 

Ihe UJtl so Ihal Ihe reader hai tufflcknl baek- 

jtrnvrw lo beabte lo reconilruel pmposllioiiii 

w her eV ceiiar y* 
TW ttti Hokganbed Inio jurracc chonfcr 
The wrller orovldei tuff It km le.tliial in for ma Nun tr> 

Ihal Ihz readet c*n make alt the nete«v*ry Inreien- 

tlal eonrreciloni among Ihe elements ur lie itnt> 
l .veryihlng Ihal h pretenled \n\ * putpnte wlihin Ihe 

tut r»ce plan. 
The teqnence i>f w^tntnl I ptnlmtilUfis in Ihe 

turfarc of Ihe lexl If prinelpktl. 
Theie are cumenlliimfoi Ihe tmfaee language nr 

eteh genre. 

Appioprbie suilate flgnati will Itc nsttJ Ui maik 

lunsllbni* ele* 
Appropriate rerch or language wffl he iiwil. 
In addition lo Ihe general eunvenlhin* thied above 

parrfrirbr gemei wtf^nrien h*¥e vpeerrfc le<l con- 

venitom gnvernlng ihe mrr*ee fin ml 
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llu* lr;msttiiimillim ot llu* omln lying si incline into an actual lext* As c:m be seen 

Irmri table I + their aic ; mbp ol gcnci;il piinciplcs ot surface stnictmc Iml Ihcic- 

iiic ;dsu iihosynoatic tines lluil apply to paiticnlar gemcs. Tin* present (fisciissinn 
will fnt ns on the common ones. Some Idiosyncialic <mcs will he mentioned luler 
\v r, icn wc cNwiks I l<c particnlar genres we have investigated* The principle of 
f/or/«o<cwr is /central one. The text b being piescnled by someone (i>. 4 ihc 
wiitcir who kimws where It going, how It will cod. Xheiefore the reader is able hi 
aniline Ifial c;ich clcmciil of Hie smface si incline Ihal appears is pari of an orches* 
haled plan. Nils has ciionnoiis Implications fur comprehension, as we will sec later. 
If is the beail of Hie tm Ida nee friticlple./trfl/imv cbaiacleiizes Hie an I Inn's delib- 
onlcness in diiccthig Ibe texl towaid some specific gionpof readeis who have par* 
tit dm cli;iracleiislics. Seaffi*htinR Indicates Ihal Hie writer Is awaie ot Ihe reader's 
need to have a sn|>ci struct mc conshoclcd around whkh Ihe elements of llic lexl 
can be assembled. SeftmnHaifan stales Ihal Ihe lexl will be wiillen through a series 

of disciele surface el ks* Gnutcvlmiy is closely related to Scaffithting, in thai it 

is exacted lliat alt tlie links between the elements of a soiface slroctore are con* 
sf metafile, either fiom diiecl evidence provided in the lexl^or from a combination 
of smfare hints and piior*knowledge* Closely linked to fins, however, b Ibe prln* 
ciple of 1'nmomw which stales ihal there Is a contrasting pressure to make ihe sur- 
face hum as economical as possible. Tins lea& the leader to assume that everything 
encoimlcicd hi Ihe smface lexl Is there 1V11 a reason. This does not mean that every* 
thing Is of equal Impoitance.or will be equally we(I remembered* But esdi element 
Ikis a purpose In Ihe unfolding lexl* It b there for a reason, albcll perhaps a Iran* 
sicnl one, Onhriv along wilb Conmctmty, are al the bearl of the text pro* 
ecssing* theory developed by Kinlsxfi (Klntsch and Vlpond 1978; Klnlsch and van 
Dljk l { >7R; Millei and Kintsch 1980)* Bach element of the surface text must be hile* 
^ratable iulo Ihe developing network of propositions that represents ihe meaning of 
llie texl. the existence of welhknowo limits in immediate memory and attention 
suggest that propositions that cannoi be Immediately integrated will Increase pro* 
cesstng difficulty Kinlscirs model b an explicit embodiment of these principles* 
I hially, tjttifttia&r Indicates thai Ihere are specific conventions governing the lype 
of language thai is appruprlale for performing various functions within a genre. For 
instance. Ihe evcnls of a story are expected In be lold through Specific, concrete 
Events and chaiaclets, while background Information Is given hi more generic lan- 
guage The aigument In an essay unfolds Hi tough an appropriate blend of abstract 
amf comtcir language. We will see later thai om evidence Indicates Ihal readers are 
quite sensitive to shifts of language in a lexl* 
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l£t os now hint om attention lo the two genres we have been investigating in om 
rcsr:och. In litis section we will describe the properties of Ihese genres* and will 

^0 
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tclMe I hem lo the general principles of composition di*sciihe<t c;nhct in table 2 As 
we shall see In lite next section, college leadeis use knowledge ot Ihe pjopoHcs of 

Ihese gemcs ihiiiog Ihe pmccss nf Icistanthng* hi pailicnlai, they know some* 

thing ahmil Ihc types of underlying sliiichnes allowable for Ihe genie and in addi- 
tion something about Ihe cotivenllons for tiaustmmlng an allowable omtcflyhig 
sliuclmc hiln an acceptable surface text. Knowing Ihese things, they are able lo 

woik hackwaids f Ihe elements of Ihc smface lexl they aic piesenlcd lo a 

representation of lite underlying si met me conveyed hy Ihe lexl.deaily, strategics 
tiased on litis kind of knowledge will go astiay on Ihose occasions when a text is ill* 
fmmed In either lis surface or lis mideilying sljuclme< 

4 

Stories 

Tlie faMes, folktales, and children's stoiies thai have been Investigated iolcusively 
by cognitive psychologists In ihe past few years have a simple and shaightforwjid 

si me I in e + Hg. 2 piesents In highly schematic ft Ihe basic pattern of the midei- 

lying slroctme of these stories* Theie fe a nelwoik sif hackgiound hift alioo, 

calfcd Jhe Exposition, and the core of the siory (lite Natialion) consisting of Cooi 
pftcatlon and Resolution. In essence, a siory consists of a piohlem oi comptlcalion 
whleh gels resolved hy Ihe intentional actions of one or more central chaiaclets. Of 
cnuisc, even In stiiipk storks Ihere ate many ways In which Ihe simple schema 
shown In rig* 2 can be* made more complex, further, llicre arc constraints on what 
kinds of complications and resolutions will produce acceptable storks (ftrewei and 

Lichleuslehi 1980; Wile nsky 198U;Orson In piep )*Bul llie general pal lei n of c * 

plication and resolotton b al the liearl of the types of simple stories eve and otheis 
liave Investigated. 

The conventions of composition for sJmpte lexti can be translated qolte dhectly 
for these storks, Tlte purpose^of such sloifes b typically lo aoiuse or eiiletlain, 
though of course many are also used ht InslrucL These stoiies achieve a lialancc 
between Ihe familiar and the novel by following ceil a hi stereotypic patterns of plot 
development **lth familiar character types, out doing scr with partlcoraj novel Iwisls 
or sutprtses of detail, taicr we will see quite clearly lire conseqoences »f this for 




EXPOSITION NARRATION 




COMPLICATION RESOLUTION 
1 1*. 2, The c'rnwhii nf iioty simriitif , 
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pimrstiog. Al Ibr IrvH ol undcilyiog slmctmc llie sbny fallows a basic plan of 
< oiillicl aitd umflicl lesohilhm* willi a mimhei of acceptable fniins »f complication 
□Unwell within this gciteial fiamewmk . Hie readei expects all nf tlte elements nf 
lite stmy In fit into a cnheieot general framcwoik, each element loving lis place hi 
nn nveioll plan and llie ertlhe pbn having a deai lesolution.Tlie eptsndes of a slory 
mini be causally connected* bnl only those causally emmected episodes hi which 
cnnMicI is nealeil and revived can be astnry* 

Hie principles nr smface niganl/allnii chaiacleri/e Hie way in whlcb an under* 
lying stoiy geh told. In this repaid, the principle nf Otmfaienvc Is a central ime + 
fl>e snny is being mid by someone who knows how It will end, anil therefine the 
icinler assumes Ihal each element lhal appears W part of an mcliesl rated plan* This 
is i he heail of the (iuldance Principle. The SvaffoMwR pihiciple asserts lhat every- 
lliin^ needed lo make (he slory understandable will eilher be apparent im the basis 
of geneial knowledge or will be provided by the writer In shirks, ifils Information 
is Tiequeiilly ui the form uf background or selling hifotmatlon. There are many 
omveiiliims fur presenting background informal ion* A recent monograph by Stern- 
beig { l°78)desaibes and Musi rales many nf Ihese, In very simple stories/lite back* 
giimiid is usually pi?seMed al Ihe beginning* However* (here Is (he wellknuwn con* 
ventlon of in tttalfa* re%. wliere the stury begjnsm Hie midst uf specific actions and 
llie necessary backgiound is wuven Into (lie development of (he plot* S(ernberg 
describes oilier leclmkjnes as well. Though we have not Investigated Ihls directly, 
we oitifd guess dial lite placing of background informal lun In locations olher I flan 
ilie beginning could complicate Ihe (ask for (lie reader, though (lie writer can do 
nmch In minimize the difficulty by (fie way In whlcb Ihe Infuniiatlon is introduced* 

ScRnwrttattim for a story means lliat H is told through a series of discrete units* 
in parliculai Jluough specific scenes or epbodes lhat are separated In space or lime. 
This is a piopeily lhat nairallves and dramas share. The conventional organlzatlun 
of a play bilo scenes Is a good Illustration of Hie point. 

Orderly flow ami Cmmectmty are fundamental principles of text processing* 
f-ach elemenl of Ihe suiface structure must be Inlegra(ab1e Into the developing net* 
wink i>r piopositmns thai repiesenls the undei lying story* Economy Is an extiem* 
ely imporlanl piinciple foi stories. Readeis expect that everytliiog In a story Is 
theie foi a reason, U a stnall detail is mention^), especially In isolation from other 
details* leaders ex peel It may be Imporlanl. Of course* In stories such as murder 
mysteries, attention to small details may be elevaled because of conventions asso- 
ciated with this specific genre. But we have seen much evidence In our reseaich of 
readers paying special attention to deta'ds eveo where tliey are ultimately Irrelevant* 
There is no conflict between (his and Ihe fac( that details tend not to be well- 
lemembered (Thomdyke 1977; Mandler and Johnson 1977; Meyer 1975)* Some 
detail* may seem Important when Ihey are firsl encountered In (he slory and may 
receive special altenrhm even If they are not central lo Ihe final representation. As 
a result. Importance defined as a- proposition's hicathm in (he hierarchy of a theury 
uf story structure (c* Tlmrndyke ?°77) may nu( covary with reading times in the 
same way thai recall dews (but *ee*cx, Clrlki and l : uss 1980). 
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Keadcis have specific expectations about the IjtttmaXv In which simics will be 
(old. hi pail, they expect them In be told hy means nf specific, cmiciete events and 
chaiacteis* Tlte episodes that cnmpiise Ibe heart nMhe tfmy nmsl neenr al a spc 
cIRc (tine ami |>lace, and theie most Itc paiticular characleis Involved hi Ihe epi 
smles* Statements aluml geitrial pal terns nf events or Ihe dispositional pr»|>ci lies nf 
chaiaclers aie elements of (he background* Stembeig (1778) descilhed how the 

contrast between particular events ami si tiaites nf prtoi actions Is used to differ* 

entiale Narrallini fmm Exposition* Our evidence Indicates readers are i|iiile sciisr* 
(Ivelotbls. 

We liave fuund at least une idee example of a genre s|>cclfk convention fur 
stories. The motives ofchaiacleis m causes fai actlmi aie almost nevei statctt expli- 
cltly* Tlie motivational structme b almost always Implicit, though l( rs cleaily im* 
poitant for understanding the causal cnimectioits atiKmg events In ti*e stoiy. The 
task nf figuring nut why a character has done something rs complex, and ie<|iiiiesa 
general Ifteory of goaft and plans on Ihe part uf (be understanding system {e.g., 
Wllensky 1978, 1980)* Nu doubt there are many ullier such conventions, hut lids 
particular one has very Important consequences for piocesshig. The Implicit Infor- 
mation: mutt be recovered In urder to understand fully the connections among the 
events. 

Sm\ptttnay% 

Unlike the simple stoiki we have studied, simple eassays du nut have as well* 
defined a fonn al either tlie imdeilylng or surface level* Tlw slm|ile stnry has a 
lightly organized structure, organized around a plot, a series uT events thai are caus- 
ally lelated and thai unfold In the eonipHcatlon*reso1ullon plan descrilted eaillei* 
However, essays can have many fomis because they have many purposes. Fuitliei, 
each type of essay seems to be governed by a looser set of conventions than those 
found for nor lei This h not stfiprlsmg, since even simple essays'aie written for a 
variety 'of purposes and tlie mapping uf purposes unto iheluilcal strategies is qidle 
llexJble. Ifawever* tiioogfi thb genre Is more loosely stiuclured llran the simple 
stoiy, leaders do liave expectations abuu( the (ypes of striictmes tliey will find. 
Let's took at some simple examples* 

One common type of simple essay Is the Inductive argument. The aiitimt's gnal Is 
lo. convince tire leader of a IliCsb.aiid evidence relevant (n the thesis is nieseuled as 

(tie Iteart of tire essay* At Hie level of underlying structure. Inductive arg entsdo 

nul have a linear organlzatlun analogous to tlte causaljempora1urgaiilr.a1luii fuund 
In stories. Theie Is the thesis Itseir and statements of Ihe evidence peitineiit In lite 
thesis. Any particular thesis has the noleiillal for an Indefinite number of evidence 
statements that might be lefevant to M* However^ as a practical matter nf texl con- 
veulloiii a tltesis b typically supported by a modest iiumhei of evidence slatemenls* 
In lite (ypes of simple (exts we have examined, usually nn mure (Iran two oi three 
distinct types nf evidence ave cited. Khetnrlc hordes often describe various piincb 
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plot 1<ir sclccling evidence 4 tec. 4* g.. Ilafccr l l >7d; Musics and bohauicl l<)62;Kin- 
nr;ivy 1*71; Payne IW>). 

Al I he surlace level, there aie different ways 1u arrange an Inductive argument, 
fulluwing llic principle uf Scajfitkiwg. huwever, the writer must always give the 
render enough hurt kJ net my in for mat Ion to make tne unfolding argument structure 
apparent. Typically, this Is bed done by presenting ihe thesb at the beginning of 
the essay The evidence b then presented, and the thesb Is restated al ihe conclu- 
*iim. Alternatively, the evidence can l>e presented first, leading to the statement of 
Ihe ihcsls at the end. If thb b done, however, the writer mtisl take special care to 
iufumi the reader that ihe evidence supports a thesis which will nol be revealed 
until the end of ihe essay. The evidence itself can he ordered In different ways, em* 
outlying the principle uf (fatcrfy flftn for essays. Thete different urderlngs reflect 
rlie persuasive purpose of the fuductJve essay. Mosl autJturitks agree that the rnost 
jtcrsnaslve urdeilng Is to put the very strongest piece of evidence at the end J low* 
ever. Ihcre are various ways to organize the remain! ig pieces. The climactic order 
builds from the weakest evidence to the strongest, v !Jle the Netfnrian order starts 
wllh Hh* secuiitl strongest piece and then builds from the weakest to the strongest 
Olughcs and Duharnel l*K>2), Unlike stories, Segmetttathm for Ihe essay takes the 
form of paragraphs with information chunked according to topic. There are prin- 
ciples which govern sentence organization within Ihe paragraph. Por example, 
Kieras (1978) has studied readers 1 expectations about the placement of topic seiv 
fences within paragraphs. Our ovpi data suggest that readers also have expectations 
about how lite principle of iMnptage Is Instantiated for essays. Readers expect a 
paragraph to be a blend of ahstract statements of general principles and specific, 
concrete Illustration* "r examples. 

Another common kind of essay is one which compares and contrasts two 
cnlilles. Por example, in work which we will not be d esc rlhlng, here, we used two 
such essays, one in which a football halfback and a ballerina were compared, with 
cmpfrtsis on theh similarities* and another In wlrkh two very similar maladies, heat 
exhaustion and sunstroke, were compared, with emphasis on their differences. 
There ne two dominant types of organization for such essays: one In which all the 
properties of one enllty are described before all those of the second, and anotlter in 
which the two entities are descrihed concurrently, with parallel properties 
described hi alternation for the two. Thb contrast is not particularly surprbing, per* 
haps, but it does influence what readers expect to find once they realize the pur* 
pose uf the essay. 

FmpiHcal Investigations of text processing 

ttt us now briefly descrihe the lypes of Investigations we have conducted. Our 
strategy has been to use a number of different tasks to Iry to understand what it iS' 
rhtti readers are doing white reading, fn this section we wjll describe these tasks, and 
in ihe next sceiioi: present some results from these tasks for stories and essays. 
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All of oii> lexis aic fahly simpk ami slmrl su wc fair use llrcrir rn riJUrtcnl laltta 
without creating very long session*. We used four different stories Ohc number* In 
Ittreiitltescs hnlicaie tlic number uf sentences pci story); 

Lrntii {$2h This story was laken from McOnskeyflfMO). and is a'wcll formed chil- 
dren's sioiy. Since wc will be discussing It hi sunte detail hler. a synopsis of Us 
plot appears in lahie 3. 

Stranger (44): Tills story was taken from Plnlay (IV69). U is also a wcO funned 
+ itoryt a fable aboul ihe costs of greed and selftslmcfs. 

CTn/e htaiU (Ift): Tills slory was uilgiually Intruducetl by Dawes ll%<il. The 
version we used was taken from Thorndyke (1977). Although this sluiy fits 
Thormlyke's story grammar, It b not well formed fur reasons we will describe 
later. £ 

llfrr of the Chut* (28): This classic was used by Dartlett (19.12) in his slntlics „f 
sdiemata. Il is an American Indian folklare. and beeauselt uses tunvenllons and 
knowledge unfamiliar to most uf us It b qulle dffficull to understand. 



cltulce of these four stories was quite deliberate. We wauled two well funned 
two informed stories to we could contrast uitr readers* behavior for llicse twu 
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SloiKp»M Content 



Sctilni AttttiU mWwtttein town calcd Alto. UMn 

CHiiieteii Until - a boy who wanted tn stag and whistle, bor cunltln i s» learned m 

" pby the harmonica Instead 

Coto net Carter - a rfch* tmpot mil nun who had given many tiolftlliigs smi 

parks to the rown nr Attn 
Old Srteep - tn okf. ctabhy reHow who coniplalnt ibnni everyihlng ami 
and everybody 

Pint Colonel Carter b returning to Altn iMct * two-rear iWmr, The town 

decides Uxhaw a celebration. 1)W Sneep mutters lhai ColnnetCaiitf itrrtlt 
to be taken down a pet or two., Preparation* are made fm thecctebrslkn: 
n*^andsaift*mfwtup<Owbmfd bat the station. Ibe nuyuf has a t\^h 
ready. Tbe tram arrltei. As t oloneK arter *ieP* Trnm the Ualo. fjtd Swep 
h aeen by al on the top or the station ttidtlnf; ■ tenKin. 1 he bsod gelt itt 
pudered op ami ean*t play, Kwrynne ta stlenVand Cn»NHiUci1, snd 
CnlnnetCanct hejtlm tn look angry, tentll savri the day tiy stepping un 
and playing nn hh harmonica. Colonel Carter Is pleased, and a happy cere- 
bration It bad hy ill. Includhv Old Sore p. 
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I irs< <tu* iMMjitaphsof t rt/fr-tfrrjf cscays, 

Itcll fri;i|}fd 



lll-f'>imcd 



■ — - 



I Omtdd stari lt>- ml n tilling Uial a* lilitr 

ripiiih have scented n*o tauHful anil expcn- 
sisf* t 
1 hv r,ii|K*(iiip ihs'n ataihldc would have 
Inrn o>stUMliftlrii1l hi maintain, and 
u<niM have minimi frctpicnt leplaccnttnt. 
Now* lii*ever+ Iterance \if Improved materials, 
the arguments mi faviu of e denilve rarpcllnjE 
*ccw a preal dcat iimie plausible* 
Nrw indoor onldoor sYnihcllcsarc slain 
icsioaui, fade rcsklani, durable and inex- 
pensive, 

1 \wy have iuao*c caipciing sectn much (ess 
a luxury than a icasonabfc , even desirable 
;ilti rn^Hve hi tile Itfutfs, 
Itirrfly, ilwie seem to be three central arpir 
thrills in favni- i*f t Pipeline. 

I It it. i*f rourse, rar pcifnn It a| tractive* 
No*, admittedly, modern leclirtolnpy offers 
a peal variety i*f attractively tutored llkv 

I hr daysofdrah. Institutional ptays, pweena, 
:»nil Iwnww in tlte aiC nvet* 

ftui white hie may appioach caipetinjE In 
terms of color, il has a hard and unatitactlve 
regime, 

taipciin^, on ihe oilier hand, is colorful, 
attractive ii» the loueh, and eumfmtaMc <o 
vsalk on. 

II n>cs a In up way inward ueatinp a pkasanl 
atiiu«pfierc all ipf us would like lo *ork in, 
IhiiIi to and out of dass. 

Richly colored carpeting, such as hull fed* 
often used in hanksand eniumeidal offket, 
uoidd make our facitllks lev Institutional 
Hirphl earpctiue can easily make attractive 
;tn area thai would other udsc seem Spartan * 
and sicfilc L 

In short, carpeting seems (fair-able simply 
because il is mote alltailkc h>lotdt ai and 
u;ilk <*n lhan tile. 



As liHlr at live years aprsarpeied 
( lass* tiMius would fifchtly have seemed tin* 
1,i m Mul aust expeucive, 

1 Nkt carpeting then available wmittl have 
been eosily , difficult b» maintain, and 
would have required fro|neni replicemcuL 
Improved materUh have made Ihe arpu- 
inenls in favof nf extensive carpciinp seem 
a peai deal rmue plaurib!? . 
New indoor imhhmr syntlielks «c slain 
reslslani. fade re*islant ( durable and h>cs< 
pensive. 

They have made carpefinjt seem much lc<s 
a luxury lhan a reasonable, even desirable 
alternative In lilt floors. 



Carpellnp Isaiiraetive. 
Mmlern iccbnnlnpy offers a prcat vartely. 
of aliiacilvely cnlnfed IttcSn 

days of dfJIb; In^Kiulhmal prays, gicens, 
and browns In life are over 
WhOe i lie may approach caiptiinp in icnn* 
of enhtf. II has a hard and unaltfacifrc lex- 
lore. 

CaTpctinpIs colorful, aliranive lojhe louch, 
and comfortable hi walk on. 

13 pocs a long way toward eicaiinpa pfeasanl 
almosplieTc all of us woold like lo work in. 
boih in and oui of class. 
Richly colored carpcilnp, such as bold reds 
ofiiMi used in hanks and commercial Hi eta, 
wiudd make our facilities lew institutional. 
Ilrlght cm pc ling can easily make attract ive 
an area: lhat would otherwise tceio Spartan 
jfhtl siciile. 



Wc will also rcpotl thla fin Iwn essays, c^cli nf which had lw<i vcision* crcalcd 
hy cnihmiying the itntne muleilyiiig stnictutc in iwu stitfacc furuis. The essays wc 
m&\ were; 



7G 



CirrfH'titijz (.17): Tlifo |K*rsiiasJve essay aignc* llial cjii |ic(iiif> is really c cusl rife* 

live linn lile fnr clnssrouiir lltxirs. The slarnlaVil versitm was lakeit fnnri Daker 

(I97fi)* We crealetl an IIITntnicO versitm hy re vhif* I lie signalling devices from 

ihe suffice slrlidtne. T\\t flfsl Iwu paragraphs uf Imlli versions of 1 his essay ire 
* given hi la dk 4 + 

he Arc (22): This essay tlescrH>es iti a fairly factual way Ihe |i<rssthilHy fltal we 
\ may be facing anolltcf Ice age. Il was laken frtnn Junes and Faulknet (IWI), 
Tlte Iwu vtrsiurts tllfferctl In llial one presented lite ihesls ai Ihe licgjtiuhig fid- 
lowed by Hie evidence, while, Ihe second meseiilcd ihe evidence Hisl. fnllusvtd 
by lite Ihesls. Thla seen rid vcrsiun II llirnnned heeaiise il ilocs mil tuukc il clear 
fw lite? leader Ural Ihe evident* will precede lite Uresis slalerncnl. 

For all i>f lite leafs used hi ihese sliidles t an hidlcallun uf ihe hn|u>rlaiu e uf e:ich 
cotislllitenl was obtained by harh>M" Indepcitdeiil gujiij>;if snlijeds cnissnul half 
Ihe material hi eaclt leM and Iheii ftblahilng a pri>nk t>f Ihe frequency wlih which 
imlivftlnal eleuteiila were deklcd. This ittfuMrralhni wlJJ he referral tn as ftttf*rr 
tatu-e Ratutgs later In Ihb paper. 

Subjects 

AM of Ihe subjects lit ihe studies lo be described were eollcgc slude»i1s who were 
paid ai a rale of $ 2,50 an hour fur lltelr participation* 

Tasks 

We used iwu different tasks wlllt eaeh of these scls of rrralerials, iishrg'tlrllerenl 
groups of aubjeds fur eaclt task. 

{ttTatkitlxtittt kmt 

The subject was sbuwit e^tsh sentence hi the teal <nte at a linte. In sct|iieiis*c,and 
was askedlu talk nut hind into a 1a|>c recorder alnuit a nuinher uf ihhijis* In par Uv- 
ular, we asked subjects tu talk ahuitt any inferences ur elahuratiuns lliey fell cum- 
pelted to draw mi Hie basis nf the current sentence, any conned huts lliey saw 
helweeti Hie amenl sentence ami aoy prtur ones, any predlctimis alnml whal mighl 
be coming up, and any a mm ten Is lliey Itad alntnl the Ie>t1 or lltelr mule rsl a tiding uf 
il. Subjects wIki talked nut Imtd tu the essays were alsu asked In ctumnettl on lite 
rsile an htdlvhltial sentence had Im lite uverall urgaitixallurruf the essay if lliey fell 

csHtipclkd tu. Tlte tapes from these scasiims were Iransctlhal, ami checked il I lie 

trarjScripthms segmented htlu hlea units and lire mills classified hy lypc ut sink 
trteitt. The segment a I Inn and classifieathm we're checked fur reliability by having 
two people per ft inn these tasks. 

t - 1 

(2) /trotting fim<r 

Siritjevls were picscnred wtttkcach tent ai a coni|mlet IciuuuaL l-adi lune 1lrs*y 
pressed a key lite next scitlence uf the text appealed. Only imc srnieusT was sbuwit - 
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al n I line. SohjrcH wcic lohl loicad llic IckI as normally as posiihlc Those reading 
Ihe wcte l-M Dial lalcr nn we wmihl cxploie how well they uiulctsi.Mtd each 

sloiy V.ssay icadcu wcic lold llial ihcy would lalcr be asked lo wrl(e a imc-scii- 

icticc n a.y nf each essay. Tlic primaiy data rmm tins task me llic limes suli- 

jeets devilled I" eacli sentence in cncli tcxl . 



Pm retting simple storiw 

Wlwit is a lender doing while readltig a single slory? This question has been al tlie 
licaii or a series of hivesi igal ions we have been carrying owl. In tliis seclimi we. will 
piescnt a broad sketch of nnr view of what the reader is doing, and then erescut 
sevcml scls of data humour icscaicb tbal provkles support of tlds view. 

Tlie icader o( a simple stnry is cimfrnnlcd with I he following task. A text em- 
bodying various aspects of tbc story is available as Ihput. The text will be processed 
against a hackRiniiud of several types of knowledge tbat are relevant to li.The final 
producl of understanding will be an inlerpreted representation of tlie essential cle- 
mciils of ihe slory. However, with mosl stories, this representation musl be am- 

Moictcd fro complete Information in llic texl. Much tliai Is important to Inter- 

lading ihe elements of tbc lexl asastury is left implicit. 

To try to give a cimcrete idea of wlial readers ale doing wldle ceJdhig a simple 
sn.ry, lei ns descilbe some of uur talk In gout -loud data for several stories we l.ave 
been examining. Table 5 presents the relative frequencies of dlffeient types of 
things reaile.s talk about during ibis task. As you can see, most of their talking is 
deviated In making Inferences, generating predictions, and commenllng on coniwc- 
lions to>lor Inforination. The relative frequencies of time activities are roughly 
Ihe same across tlte four stories shown In lable 5, though there are st.ine interesting 
exceplions ihat we will comment on later. Thougli comments about the story or 
ahont Ihelt own .ti.de titan ding are low hi overall frequency, they are very diag- 
nostic nf aspecls <d slopies that readets ale sensitive to. 

We will Orsl consider an example of a wcll-formed simple story in order lo show 
how the principles bear upon what a reader is doing during con.prelienslon. lentil 
is a straightforward child. eh's story whose surface organization is quite simple. The 
Cusi 17 setileuccs are Ihe Exptnlilun. in which the three major chataclets and the 
seed* nf Ihe pnlenlial conflict ate Introduced. The Nariatlon begins with sentence 
18 and Ihe climax that distii.gidsl.es Cm. plication from Resolution occurs doting 
seiilcnces .10 to .12. Our analysis of what readets are doing while tending "Lentil Is 
bawd nn Iwclve stihjecls who talked mil bud while reading it. Laler we will 
•describe how I he talking-ouMo.td data correspond to tlte senlc nce hy-sentence 
icadhie limes of at.olher gtoup of subjecls who were reading silently. . 

Tlu.mghoui ihe F,xposiliun of "Until" Ihe talklng-ont-lowd subjects were clcatly 
cikciiug information ami fom.t.ialh.g tc.talive l.ypoll.cses ahnut what was likely 
lo happen in ihe sioty. They all iccogid/cil thai the three ccnt.al characters yield a 



73 



imi ti M oht 


*H4't4tt /i t 








1 jii»ic % 










Ptt»l*n llim nf \;\\kbiR »iM MM \mu 


Im 1 knit inearll latently. 






rakpny 


l.rriltl 


- 5* Italian 

* 


t*1 II Hit 


f litk lilaiu 


Ptctlli limit 


ill! 




«. 1 J 


ll 2* 




OJM 


0,112 


II III 


11 III 


fnmincnli mi timeline 


11,09 


wm 


iuib 


11 til 


I online nil im own Mwtw 


0JI3 


CI O J 


CI CM 


n<02 


( onfltmallnn nl" pte ilklkm* 


(1 112 


\\m 


Cl.lll 


11112 


fUreienctt In anleeetkni 










lnl"ni mallon 


1129 < 




0 311 


0 27 


Inktencet 


0 jo 


CI. 24 


0J0 


1127 


nrnciftl JkniuvkitRe and 










aisocla Ifoni 


1KH2 


01M 




OJUs 



highly probable Hue nf conflict ami resulolimi: Old Sneqi and Cnhiiicl (%nlcr will 
be the source of the conflict, and Lentil will provide llic tesiilminir Al sentence* I ft 
aitd 19, whete ihe Nartaliuii logins, Hie subjects bionghl Ingclhci Ihcir iciiialive 
hypotheses ami Jiiriunlatcd general plans fur Ihe rest of Ihe stnry, TaMcO ^Ih^vs 
simiic examples nf whal snbjecls satd at Hits pohil. Il was striking In ns linw rcgnbr 
tills plreuiMiiermn was: virtually all snbjecls did ihe same Ihing at nlniiil llic same 
place in the stoiy. 

TlirnuglKMit Ihe pioccssing of Hie Narutiun the hypnihcscs consttncleil earlier 
by subjecls were fn evidence, t Lracli event was incnrpniated hiHi the gcncial |tlan 
const rncled at the em) nf Ihe Exposition. JTlie Impacl nf these hyixillicses was 
loosed ra mat Ic ally revealed al sentences 30 ami 31. The leaders knew snnicilihig 
was going tn happen, bul IkhI nn tdca what. Cnnsisleiit with \\k eKpcclaiiim llial a 
stnry cnntalns novel elements, the readers ex|iccted In be surprised hy Ihe s|iccifk 

l^amnk«oriurfcrcniiinictih Inwnknr* t(* in "LctiltT\ 
SubjcH rnnnnenh 

24 *t Csf>ecl ibe |*to| wilt *uce«it hi p*Hlnp llic CnMnrl i" Iwai I tnfil f*|av tup Mt 

ttarinotika. I Ut HiMikI will be iwprciwl and Lt init w*W \*c ic^otiK il 
nnnchnw**H 

I 7 "Maybe a cclebiailnn it planned (piKiik, cfr ) and LcmU win ilir iby wlih 

* ■ loiitinp wtkwnilnp annjf \ 

07 * \ speel |o teail 1bal ( nltfiwl t alk) m»w will Piavc ^miic kiml »»l n»k in ttl<al> 

puiup nn * lih A1tn and U\n mii^k ami 1?M SmT|». i^|icri hi heal ^niwlliinp 

■Imul rnlnnctr % afkrt icai.|ftin In ttnlif \ 
2.1 *'Wcc^|»cf| in we MiM fnicfaciltfn liclwcrn i iiltmrl ( ai Iti , t IM Sih^ i^ ami 

tcnUl. fWliality a putnl ct lcbialiitn. 5ii^|*rt I llial l^itlll will inviltaMy In 1 

atfctil 1n nlay Pm li|m*\ 
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l*iH!i ■ ■ I rhr u*iiipln .i( ii mi , I'vt'ii ihnih'h they knew il wonhl hiviilvo snuirlhioK tli;i1 
Did Snrrp t|i*CH I'* lolnnel ( arlrr Si'ntcuiT M). ^heu I here was a wcl sound I ruin 
;il*nvc" is loialty ^nrfu ^mi>^ Nn cme can 1 c II al I his |niiul whal I Ik* wel sound is, lint 
nicisl snliji v k sialcd imincili;ilely. prior 1i> gniiigiiii in sculcuce } I , Ihai OM Sueep 
umsl In 1 implicated ami lhal the climai is al hand, liven though Ijenlil had mil hccii 
loootimicd since sentence M, nn>si snivels predicted llml Ixuilils central role in 
Ihe shoy vfiij ahmiMo enicige. Tims. Ihe "wel snmifl** is a highly informative evenl. 
■localise ihc slory is wellwrillen (al leant according In Hie cimveuliiius fur s#ch 
i ' 1 1 i }d i ( % n \s slurics). (he hypothesis hnsed predictions subjects made in le.sponsc to 
tin* climactic event weie in fad lighl. Once Hie climax is patted, I he mode of Pm- 
ceasing chan^il rprile drastically- The rcailers appeaird to be o|>cralirtg in a con- 
rinnnltiry jncnle. Nil new smpriscs were expected. Over and over one finds hi the 
pidincols statements like "Tint's whal I expected" or "Yup*\ fmlrcaliiig ihat pre* 
diet ic gcuernlcd were now being found hi he coiigrocul with Ihe emerging eMail* 
i*f 1 lie Resohilmo, 

"I mill" Is a goml example of a story where ihc wiilcr and I he reader are operat- 
ing in hatimmy* The Ixposithxi leads all of Hie renders to eslafihsh a background 
:iihI a sel of hy|totlicscs which successfully guide Hie subsequent processing. The 
same c^H*iialiuus are derived hy different readers at just ahoul :fie same points in 
11k* stury. and 5|>cctllc events tend tu he inter preied in I he same way, The climax is 

especially siiikiug; ; n gh il Is unpredictable, il is i edialely inlerprelahlc and is 

Jnlc^r ;tlcii ml" ihe^general represent tfi inn of tire sinry being constructed hy the 

ir;ider. 

We, have contrasted ^'Lciit II" with several oilier Mories, sumewC which clearly 
violate the principles listed hi lable 2. We will hrielly menlion/fwu of these. The' 
version i>f "Circle Island" used hy Thomdyke ( 1**77) has twupcrhnif vlulatirnis tif 
i he principles. I'irsl, the whole slory vlti|a1e<l I lie principle fl{2) in lahle 2, which* 
U*j slories, claims* Mini ihc Nnnalioii cif Ihe shiry mlisl he told hi specific, concreie 
irnns. In ^Circle Islnml" nu .specific characters . ^rc developed and no -specific 
actiorM <*f eveios are rlescHlied. Most stihjecls in I lie talking ruiMoud task assumeil 

Mie lexl was ihe l.Kposllh f a slory. Many were surprised when il ended, staling 

thai I hey e*|iecicd a Narration In /olhiw, Tolhese readers the story wa* 1 old al the 
wroiig*lcvel The sectuid pruhlem waslhaMnosl suhjecLs could mil link Mie last sen-' 
trim* wiih the ^revtous.scvenleen. The lasl sentence slates that civil war hroke <mL 
fnMisiihjects cioisistenlly staled Mint uol ei^nfgti kiformathm \ml heeu presented In 
allitw llieni lo ccmslrucl a reasimahle. scenarn> whieh led tu a civil wa*. Thus, ihe 
principle "f Gwtvrimty was violated, Since "Circle Islamf* conforms lixllie story 

yx. our dt'scrihcil hy Tlmriulyke, tins is a good example rif how adhcieiice lo a 

shoy gran'mat is not a sufficient condilioii fur a slory lo lie weH-forn>etL 

IbrlkM s (1912) famous "War of the Oliosts" is nol even well formed at Ihe 
levef of umleilying struclure, al lensl h>r teadeis Irom utir cullure- Keaflers have a 
h*nihle time with il . There is no evidence lhal any r of the Iwelve sithjeets win? 
Lilkcd not tmnl lo this tfory ever rorumlaied *a cohcrcul hyi>olhcsis ahtml Ihe 



pjiihal oigaui/nliou of the slury, alllnmgh some weie ahle to gcueiak* somr hic:*l 

liypiilhcsrs. I he confiisi *f irui snhjccls Is ilfustratcd in the coiomeuls in tahle 7. 

a I hesc c tent*; were all umdc hi reaclimi lu the sentence in which jtlmsls aie Hi si 

lutfoiluced. In this sentence, one of the main chaiacters Infers that he has encuum 
lered gliosis; The hasis fur litis Inference is nut at all cleai to readers horn our cul- 
lure. The eoiifustuiis generated hy this seuleuce Include lnw level cuiifusiou ahoul 
Ihe leferenls uf promums as well as coiifushm ahoul the hnsls foi .the gln*M infer* 
ence Itself, 

Maudler aird lolmsoii (l?77) presented a convincing analysis whieh sluovs Ihat 
Hie primary prohlem with "War of the Ghusls" Is that readers have dilllcuHy con* 
stiuellug any eausal links hetween Ihe individual rplsodes which folhiw each uihrr 
In time. Tims, readers cannot discern an Ormtt /»fan. since neither Oihvmu v nor 
,Comphw\€te can he detected. Purther* there aie lou many bizarre or nnlamillar 
events, so readier s have difficulty assimllailug Ihe story to a Omirnrtfutaf Mtrht 
One ean eontj^ie Ihrongfi the lis! of principles hi Jahle 2 anil show tltat "War of 
the (!hosta" provides examples of viola t funs of must of them. 

Dy con I railing Ihe talklngotil-lmrd protocols of suhjects teadiog well formal 
and lll ^rnied slorfes. we have gathered coiisldetable support for the claim ihat 
readets possess the kind of knowledge described In table 2. Pdrthcr, these same data 
seem lo reveal how subjects use this knowledge In theit Inteipretatlon uf eaeli sen- 
tence us they ejicountet II lit a stoty. However, gJ^eu the obvious aitltlclality of the 
talklng*out toud task. Is there any connection between what readers tell us hi litis 
task and what reader ^ do JrTa lask thai more closely approximates uu;mal reading? 
To answer this, we collected reading times for subjects who read each story silenlly 

T.We 7 ' 

t;^iiN|>ks oficader cmiunenU lo |1toil lenienre In **W« of lire Utwstt". 



5tuh|eet Comnrenls 



B ''1 don*» gel lint il lit. ttliina iMuh II rerers lo il*e lesl \tt ilie sinry", 

9 **J» lie itwe tmthn? Sooieltoily^eMliet Iih1kmu<tly «r irflmftly Is si^rsilttft 

IImi some of ihcie eoi^d be p;hos»j CVuld be the winlnfS, ittc yimoft men, 

Ihevlukncr". 

I 2 "I einl Imuine why lie wcnW say Mm, unless may lie iliey were C|*rjhinjr 

1 3 "tctnic-Mc) Ah* **dt* itie yomip niao ... nfi* I dmv n hUnV \w O^ ^oimro" 

M "Jers. I iloo'i kmiw wtial ilietieil ii pifiijt im. Ihcy are afraiJ of iuimehidy % s 

thitil? We donl know wJio r One fit live town people? Maylie Ihe wnrrkirs 

are ffiosl*"- 

15 *Thh dotttt'l teem to tit to anywhere. 1 have nit fclca how lit lulnpiri mis 

aroieoce or eveo where ilils aenieoee came fiotn 4 *, 

16 **t he yonofc man llHnathr I In I Ihe ... nol sure whal II mraits, htii ihm* were 

wme fdinoUhe ^uillfk^ lo *ht Imlfan. 1 Ji*i»*l roniw wlrai iliar itiejjris". 



s: 



.il a tooipolei leiuilual. (hie oveiall effect iti the lending times Is Hial Ktoro/" r/ir 
<,7*n/i wa* lead iniicli uwjie slowly lhan any of llie utliei llnee sluiies. The average 
lime pe< syllable w« 415 msec, complied tn 27fl, am] IflO fur Unfit, 
Sttartjtrr. ami CVnTt /sfwiif, respectively. Tins diffeieuce was highly significant in an 
analysts of vaiiame </U. W - I3-2.T < 0-001). This Ills hi nicely with llwoveiill 
genet al confusion shown by the talking out loud subjects who weie leading llbro/ 

We also examined llie sentence hy-seulence del all* of (l« reading timet. Fig. 3 
shows the type nf data provided by this reading time task.Thb ffguie pitsents tire 
leading ralet for a gioup of twelve subjects leading "Lentil". Tire leading rate* 
shown on Hie oidinate of fig. 3 have been adjusted lo lake Inlu account difference* 
in lenience lengih. A qualitative exiintnallun of these teadlng Mures teveals some 
interesting correspondences with the talklng-ouMoud data. Notice I hat theie ate 
uomeious long leading lates during the early portion of the itoiy. These ate nijjit 
likely due hi Hie attempts by subject* to stoie background Infotniallorrand fointu- 
late geneial hypotheses. Of paitlculat note are the long times Tor sentence! 1 6 through 
20. whete the fcxpodiion shifts to the Narration* This Is wheie the talk logout -food 
subjects wete fonnuliHng the geneial hypotheses they used to guide their fuilhei 
piucessfng* The peak al sentence 31 and the flat leading times alterwaid corre- 
spond, respectively, lu the large amount of Inferential and ptedlctive activity at Ihe 
cllrnaft followed hy confirmatory piocttting thai we noticed bi lire 1aIking*oul-luud 
data. In geneial, the pattern of leading times corresponds to the readei't pattern of 
processing slfatfgles levealed by out analysis uf tire talfclng-ouMoud protocols. 

These qualitative Impressions fot "LenllT* were supported by a quantitative anal- 
ysis of ihe leading times. We peifmnied a stepwise multiple regression using the 
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menu leading time pci sentence as the dependent vnifcihle ami a series,of poxiihle 
pieilUlor* of reading time as the Independent vattahles | IJ. Tabic fl shows Ihe i esulis 
of this analysis. ThHIahle shows Ihe vaibhlesihal weieaml weiemit telecledhy ihe 
Me)iwise multiple regression as significant piedlctois tif leading time. Two analyses 
aie 5hiiwn: mie that did and one that did imt Include the serial position of the sen- 
tence a* a vailahte. Nule that in both analyses the number uf syllables per sentence 
accounts fui a vciy laige |»eicenlage uf the variance in leading limes. However* in 
atldilkm. the nuiubci uf inferences made hy lalkfng-miHoud subjects also entered 
as a significant pieOictoi, and hi Hie second analysis wheie seiial po&Jiluu was 
excluded, lo did Ihe number of piedkllous* What these analyses ieveal Is that iheie 
is an assoclalluu hetween places hi "LenlH" wheie tlw tnlkhig-otil - writ) subjects geu< 
eiate hifeieirces and predictions and wlrete Hie si lent -leading snhjccls lake mote 
lime. To us, tlib suggests quite shoiigly (hat the hifoimatloii we collect from Ihe 
tat king-out -loud subjects b useful In helping us lu few mutate hypotheses an lu what 
the normal leader to doing while leading a simple stoiy. 

Tables 9 and 10 show sltnllai multiple legresshin data fui oilier sfmte* we have 
examined. In tallied another welhfuoued sloiy shows similar associailous between 
jprnpeilias or the talklng-ouUoud data foi thai stoiy and the cunespumling leading 
times. In table 10. similar analyses fur two ill forroed sh 11 res showed h'llle association 
between the taEktng-uut4oihl data and ilw leading times. Thrs difference between 
well formed and ill formed ttuiks b puleiillally Interesting, I hough we would waul 
to replicate It foi a wldei range of ttuiks hefoie we would make much uf it. Uul 
ceilabily the analyses of "Lentil" attd "Stiaugei" aie eucouiaglug> , 

|t| Mul:lptr itfjttwlun aiulystt It ■ tiambrd lUiltikif iceknW|w fm ^uvnlhallvrlv cvahiAiln^ 
\Ut lelarkwMp herwren ntw nf ion re pirJkioi vaibt4« ami • «fepeutkut vaOaiMr* l«u 
lmr*itce t In Ubfet g, 9 t iml 10, iet^idhv H«w h ihe ileremlenr v«ibHr,am1 ^mnohrr nrmhei 
vulibks exfilnted as p«mlt)ffe pie<Hclmi nf rlie reading Ihori annni ■cnleiH« J ibe trout 
"C"n*fiV\ "Sip,**. »fnl **Oim- F 7 *' tie ftlalhlki wtilcli pciraln in lite nmtumr ami Imcipic 
laiktti of ittlt *n*\y*h, "Coerr*** icfei* 1«< rltr icpiettkin coeffkknls wlikli Imltrain tinw m^iy 
unlit nf efianpe frtx'tu in ihe rirpentknr vaibMr fm cacn unit change In a rlvrn pictlkim 
vaibhfe {* M . In r«Me ft. pall I, each additional ityttatik In a ienieuce 1st eMluialeil in Iimic^v 
icniiMt llni* v> 1 94 mie«|» Titr "Si^* 1 riimiki todkatc wkcltm 1*4 *ii-t !!*e ittt\t t\1 it 

dklnr (imlkareil by ihr coeffkknl) It aralhlkaJly Jtlftnitkanl \i t , It bipe c ph mu in 

be rhf effect nf utuoial landnin vaibllnni Sckeied pirrfkrnn In iheie laMct Mt ikllnnl 
ju4l Ibme vaibbkt m\w*t elTectsare aiaiftlkally idpnlflcanr In 1I1I1 9en*e> I L billy. 1 be 'X'nnL 
/T'*" **tk\k* Iml kale *bal pt> rHulkin nf ihe Inlal v^iatkm In leadbip Outr tmrctat'ii^t *m 
leneei can be alultntled ro each piedlchff vaitotuV » m ctiinpk. iltr vaOalkm In the miud>ei nf 
syltablr* vKH*vi «rn1c»ce$ neenunli fw abtnil 7fT> nf Iltr ItMal variability In Hit icaillitp Omct 
fni lhe*e ^enreneea. wblk neibl portion only a^rnuitlt for an aiklllhitul 5%nf rffr vuktifMry . 
In pcneral, tl*c F 7 a|a|ltik b *»ne mc^tiue iif ibe icIarKe hapmlanre nf a pinlMi»Mn llie^h- 
aml Ibe nvriafi *X*nni. J?*" ptnvHe* an ovcmH loramfe uf b«w niMcb vaibtkfn In ific icmllnp 
Mitn can be oOilbuleil In llie «rl irf |ncitklnti at; wbnk. I'|iust t In |>ao J nf tank ft, slwml IT- 
iif Ibe liTlal vaibbllhy In irarilnp itntrt armtt tcutroixt cut I* amuuiiril f*»i by ihe ^rkti.nl 
VEiibblet, the icii^liiiki It unf*p1ahttd v^ibftc^i 
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t iMr ft 

Mul1ii*lr irpn %%h*ti *irt|\*jh a\ tmUnp lime* fur * % txntll", 



I mxs ,im! Mt'pulv rrf ic^MHtw a ^ 



fWlt. 



Sip 



f iMfl. /7* 



/ h*iiti fi"i rr'/ii fr*l 

Semi l^uitmn 
(liferent 



I9J 7 
47 1 



o noon 

01)1119 
0 IM»3ft 



n t 74K 
0.7B9 



f i» n tn*f tela fti/ 
ltit|*tiratxr 

t.hlfillivni 

t L i>iiiiiH % ntt iTfi imn heliavkif 
^ ( i minimi* un itrmrure ^ 
f unfit nation nf prrdlt'lhmt 
Rrlritncr m antecedent tnhtfniallnn 
(^rnftiil knnwttHpo »nct aw>rfa(h>nt 

/Vr*/>rl/*rr Jrlffei/ 
SyFNMrt 
Inktrm ei 



1*97 
t228 
979 



0.0000 
n,0O44 
0,0477 



0696 
074 2 
n.762 



/Yrr/fVfrUi rt*U (rAxreif 
Ittipmlance 
ijucili«ini 

f moment* «m own betiavnu 

( umnirnli nn iMiKtulc 

f nnrirniMhtnt tit predirllnnt 

Rf rciewe hi anlrcrdenl InroriniMnn 

i icrictrtt knntojetfpe an<| taiinnS 

I icprintrjU varfaMe - mean reeling ihne per wnrcnce. 



icessing simple essay s 



9 

ERLC 



totalise Ihey ate written and read for different pmposes^noe would expect slnrfes 
ami essays to he read iii somewhat different ways. On the other hand, since both 
employ many general linguistic conventlnns, there nuglit also to he many similar!* 
lies, Al a general level the similarities are captured by the kinds of principles shown 
In fable 2, Irr litis section, we want to focus on son« nf the differences we nbserved 
in t huw our subjects approached the reading of simple essays. Tn us, these differ 
euces clearly reveal llial college readers know and use a wide variety of genre enn- 
venlious In rowing simple cnherenl lexts. 

We will first examine Ihe data from nur talking -out -loud lask t Table 1 1 shnws 
wine penem) statistic* ahmrt Ibe frequency willr which subjects said different types 
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f* Al iHuttt rt flt / { *igm five atpf* 1 1 ttj ffttrr 



Mnfri|Hr rrpieuktn mini) ^4* nr wwiUif lim?% In* "$|i*iiprr\ 

ttiiwinf tfrpwkc tefrcitfrinj furl I Sfc f "«m. ft 

T f>«Wrf**s wfrrfei/ 

SrHjfffe* It J 9 0.0000 0.49J 

Setlal poMlnin 59 5 IMHKMl 0,599 

General kmorltdp »ml a<i*idallont 22J 9 n.rHlTO 0 659 

/VeJ/rfnf t n*rt telrtttd, 
lirtpmUncr 

^ Commctlli un strurllhe 
J f imffrm*rtctn tif prrdkiluiii 

Inferences 



1. rtrttklvri tektltd 

tnipnrfaiKT 
fttirlrlhmt 

(kncrtl knowM^e iml iwttcbfroni 

Vttdlcton not trhtlfd 
Qucflhint 

OminKtiff on Sfrurfnte 

Heft re net fn inrecttlenl Inftunollnn 

tnferrnce* 



IS J 2 OrHNH) 0.491 

iJJ 0.004J 0540 

99.5 n,frOJ6 n.wrj 

2lt7 fMrtnft 0.666 



*^ t>epriMlerU variable » mean trwtinf: Ome prt Smirnte. 



of HOngs during tlie talk lug out -loud lask. The sonrewlut diffetertl dlslrihulinn of 
statements irr table 1 1 wlien ctvrtpared with table 5 reflects tire smrrewhal different 
!n*(r!!c!iuns given to the tnlfcbig-otH-lootl sotijecls In tlte essay ta^ks. Not Jtutptb 
Ingly /explicitly asking subjects to talk about buw the current sentence Tit in tn I fie 
uverall plan of t1« essay generated more sMtements abttul Ihe structure. 

What to not revealed by these overall figures are souk verylmpoilanl rpialit alive 
differences Jn vibat sirbjecls s*Jd to essays when compared with sloifes. IViIm|>s 
ttje uKtsI dramatic difference came in I lie kinds of predictions made .by readeis* 

Note lira I hi tables 5 and tl predklkms are relatively cim in: lltev repie- 

sent aboul • quarter of I lie productions for the essays and a third for lire stories. 
Itowever, Hie kinds of predictions were very different. The typical predict Ions made 
by tire leadei of a slory were sikcJHc* They predicted specific events lhat might 
occiu liter En the >lory ( Invttlvlug specific characters. Table o eon tains lyplral exattv 
pies, Tlie speclllclly of lire predlclloos incensed as the slory devested, uol sm- 
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Muhfpk repintfon analyvh nf reading limn fm "War wf the GhmiC and "Click Hand"* 

Turn K 1 



ukulI itepwht rcfiesvfoni 



x;h*uli M 

Syllahkv + 

(icnciaj knowkdte and aiftnclallont 

frtitirtor\ mtf ttketcti 

Important c 
„ ficdkitua* 

Seibl pnrithm 
* t nttitn?ftU nn Oiucoiie w 

Reference In anltcedeal totniftialkui 

Intcienct* * 

Xlick lrta*r 

Sytttbki 

Prrdirritfi rtttf irtrrtril 
Scibl portion 
IrftpwUnce 
Piedklton* 
Qwvlfont 

Cnvnmettli im inucluic 
♦Rekienee lu anleceifeol Infoiroalion 
In kit net* 

General knowledge and auodatkma 



Tnelf 



ISA 8 

si 



Sir, 



OWMMI 
0.00211 



0*74} 
0.826 



182 4 



0000 1 



060* 



■* Dependenl vatbbk * m*|n leading Unit pei sentence. - 
Table II 

Pinpoillon nf lalklnfc^nm-lnud ptoduci km* in etdi ctlcgoiy for ttnyt. 
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Ice Age* 




+ Carpet 
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Well-farmed 


HKoimed 


Prcdfclioni 


02* 


0.29 


018 


02V 


Qucttfoni 


0A2 


0.12 


0.06 


008 


Cnmmenlt nn itiucluic 


032 


02* 


0.28 


0J2 


rnmmenli nn r nvn behavkn 


00J 


0(M 


0*03 


. 0*0J 


< onRirfiitton of predkiloni 


om 


002 


0*01 


0*0J 


Rctcicittei In antecedent 










InftfftaalJon 


0.48 


OH 


0.28 


0.19 


Infcicncet 


0 lo 


M/12 


OIL 


010 


( rnCf B l knnwtedpe and 










attodalhim 


001 . 


004 


004 


o.ol 


8tf 
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^ prjshigly. sinvc nmie ami moie hihmmilioii was av;rihihle Im Hit rcadci ^ImhiI the 
< plot Ime hebtp, ileveJnped* Mm lire imporfmil polm wn% i\m the prediction* wore 

& specific even very eaify on: iho&e shown In lahle 6 weie generated only ahmil a 
I hit J of 1 lie way hiln "LenlH". In marked conhast, Ihe piedjcthms given lit lite 
essays were rrmch more general* They often comJsleil of comments to tlie efleel 
lhal leaders expected lo see another argument t ex|>eded another example. rr<\ |}ttt 
the sjtecjffc aignnieiil ni Ihe specific example were seldom generated* We lliliik thi* 
dJfTeietrce Jit Ihe types of predictions gctwraled by readers leflerls some inijioilaiil 
dirreiences In Hie way lliey appioadi these |wo trxl types. The teadet or a sioiy 
lias a set of Htm expectations about the type »r substantive events thai will tonsil 

ttfle acceptahfe cont iimatlrurs of a story, (jpveii hackgit d hiroimaltott alMml ibe 

chaiadeis ami llieh imillvcs, di can he aiHIctpale^l abonl how the tonllicl ainJ 

icsolmton or Hie sioiy will jnocccd, Ifnwevei. with an aiguntenl, H is appaieully 
nnne dlfTkull tu pietlkl the speclfks. Readeis know lhal an imliiclrve aignuienl 
(e.f., Carftethtg) will liave vaitotis elements of sup|Hii1iitg evklnu:e Tin Ihe main 
INiltit, and they know (peilia^s lilvtally) tfiat a compaie and ctinliasl will have torn 
paibtMis and contrasts. Bui tlieh predictions do not leduce 10 flie kvel uf xpedncs. 
For example, table 12 piesents piedktkms made by suhjeclsai tfie end nfihe lint 
paiagiaph of the well-fuinied veislon of the Carpeting essay. The flisl paiagmph 
gives some background biroimaljoii, Inliodiiccs Hie thesis of the essay and an- 
nounces thai theie wJH be Ihiee aigunienta irttde In supinut of the thesis* In am* 
Irail to the cuinmcnla given al the end uMhe background section. -fur /.cvifV/ (jcc 
table 6), the essay leadeisuo not seem In he ptlng beyond whai Jhe aulhoi has lold 
them about the argumenta to be presented* 

Readers uf Hie essays seemed lo be qulie sensitive to the smface Ucvkes nsctl to 
oigantxe the components gf Ihe text* This was revealed hi iwo ways* I'irsl, readeis 
seemed to be able to anticipate the ends of paragraphs and other majtn hieaks hi 
Ihe argument quite well Apparently they were tcnsltlve 1o*the level of Ihe language 
and Hie general pace ofllie argument * l^ragraplis werenHen oiganbed by having a 

Tabk 12 

l^ampkt of tradct conimenli al ihe end ut I Ik tmruducluiy i^iatiapli nt Hie « r elMu|iiicd 
Ctptt enay* 

SuVteci ^ (ommenli 

02 "ll*i antnft In gn on lodrKfitie w\\mlU iikhT afroui cdi|>cliiie, thtorc ji jiio 

ink) hn# II r»mc In be lhal Ittey'ic mhq* mnie caiprlln^ I 1I1I1A llter'ie 
rotnft hi len itre why" 

03 v "I tx|»ecl In find oul whal Ihe Ihice ccnlial aittthirnii tn fami ut rai|Hllnp 

■ie". 

04 tm How ym\ wunld evpccl htm In ftn un and ptimlMy Htl ami pi*i*iM> i i(»bin 

each nf Ihe aiftmirnlt In fa^n «f cuprlln^ 1 
Of '^nnndi liter tliey aiecnlnt in sell iitc caq»elhic nttm. Mtty will en i»ii*» all tltc 

fitod ptibnt nf raipcltni; ami Iry In tell nir a lull" 
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P ocmI rtonn pulol madr neai liar- hcghmirtg ii.r.. a Inpic ^Inlcmcul > nml Ihcn 
lolli ^vim^ ibis wild a viiiirly ol i|>ccifir poinlsni illiisli alii mix. Ollen I lie paragraph 
wmdd ct^il wiMi a gcncial tmnmaiy This alternation of geneial ami sitcciflc lan- 
fM.ip? i« clearly a nmvcnlioii i>f essay writing* KcadeiS expect geneial statements nf 
main |>oinlt Ihry iliiiTl expect the main |H)i>its lt> he implicit. However, they 
r^ped I In' main j>miiis to he sup|>oiicd wilh emicrele examples or aigiiments. hirr- 

^ thrv ex|HTl only so modi supporting detail. Tl gh an inductive argument 

and each major supporting poini potentially have an Indefinite amount of material, 
ivi iters lend to present only a small umriher of what Is possible: 1wi> or three major 
imints. *>nc nr two examples* ert\ Readers expect this* and >j£c iliese expectations to 
cace iheir understanding of Hie text. These general conventions are described In 
ilieiiMic books Itoker 1976; Hughes and Duhamel l%2: Kiniwavy 1971; 

Vavnr I *><>'>). anil our readers weie sens Hive h> Hiem. 

The readied were alto sensitive k> surface rhetorical devices nseil to organize ihc 
In Hie reading 1 line profile for the well-formed version of Carpeting (shown in 
\\\> <t).twoofihe longest reading limes are foi sentences beginning with the rheio ; 
riral drvice. "in tdorl" (sentences T5 and 29 in fig. 4). Recall lliat subjects were 

1u|d h> read with 1 Pie goal of writing a uir ary later.. The reading time pattern sirg- 

grttt in nt ihat subjects were irsing rhetorical devices to signal where they should 
form their allenthui in order to be abte to write a good summary later on, Nosuch 
tipnals weie available in the ill formed version of the Gtrpttmg essay. Performance 
in rfie talking otit -loud task suggests that this lack of signalling had an effect. While 
reader* of I lie well formed version always had a good sense of where they were in 
the essay, there was much evidence in the ill-formed version that readers were often 
t< hi Fused oi misled as to the progress of the argument , 

Thr readers id the essay on the ice ages showed their sensitivity to the orgarrifrt- 
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I ty A Avroci' frntlfng fair (tu cticU Arnfrrwr in the uiel|-foiii»ftl vctthrrt of Ibrftrtittf, 
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riou in aitothet way. The livo vetsions of this essay varird on whrre the geneial uno 
Jnsion was stated. Those who had the conclusion staled only at the end had a 
imch harder ttme getting the drift of the essay. Their pmtocols reveakd consistent 
Hmfnsion as to the central |*olnt of what they were reading. Again, readers ex|>cct 
o he told wlrat the essay is about eaily on, arid are confused when this di>es r*ol 
lapperi. 

The leading times were sensitive to the well-fnrrnedness of the essays. Fin both 
/eiatons, the overall read.'ug tiritfs weie considerably slower for the in formed ver 
tiouft than for the well-formed ones. Specifically, a regression analysis that par 
tailed oiit variables like sentence length or ly 1 1 aides revealed no diffetence in over* 
rtl reading time per sentence for ice Age nr Coqtetittx essays, hut tj:e ill r>.med 
reision of each essay required about °00 msec limger th read per sentence than the 
velhfnrnied versions (HM 13) = 7.05,p < 0.001 ). WellTnrnied versions of he A*? 
md Carptttnz essay! took J6ff0 and $11$ msec per sentence, respectively, while 
lie Uf-foriiied versions took 4576 and 4387 msec per sentence. * ^ 

Another difference between the essay data and the story data was in the rela* 
lotiship between the lalkhig-out-loud protocols and tire reading times. A series of 
nidiipJ* t egression analyses revealed uo cleat relatkmsldp between any quantitative 
diaracteristlc of the talkin'g-oirtduud data and the mean reading times. The ordy 
/artatile to emerge as a significant predictor nf reading time was the length of the 
sentence. This is in marked contrast to the story data, wliere several indkes of 
tlklng oh I- loud behavior aere correlated with the reading times. This ts yet anoiher 
ndlcatlon of the differences in the behavior of the subjects who went reading Hie 
wo genres. While the subjecta talklng*out-k>ud to the storJes were generating rich, 
titer connected hypotheses aa tltey progressed through the passage, those reading 
lie essays did little more then comment on general aspects of the. essay structure, 
nds.showed up In the emergence of serial position of a sentence as a factor tit the 
mil M pie regressions for tire stories but not for (lie essays. Seemingly, subjects read 
iiore slowly at the beginning of a story while they generated hypotlteses ami more 
prickly as they got farther into the story because much of wfiat they were doing was 
xinflrjnlng earlier predict inns. No simitar pattern emerged In tire reading times for 
he essays, nor was there evidence In the talkhig*outdoud protocolsof a similar pie- 
llctive strategy. Story readers^ hypothesis construction seemed to lead to different 
imoimts of time being devoted to different story constituents, as revealed by the 
ntercorrelatmns of the talking-out- loud and reading time tasks. No similar process 
:eemed to be Involved in the reading of the essays. 

To summarise, the reader of an essay has general expectations about tire overall 
structure of the argument, com park on, or other point being made in the essay. The 
cider quickly recognizes the type of point being made, and at a general levet is 
sensitive to the organizing devices In the surface structure nf the essay. However, 
uilike the story leader, the reader nf an essay does not appear to engage In rich 
lypothesis generation and testing. The reader seems to adopt a more passive strat- 
egy, waiting for each new Hern of information to be presented and trying to fit It 
uto the uverall sclien.e of the argument. 
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Of course* one ought Jo he cautions in ovcrhilerprelrug f lie behavior nf rentiers 
ftimi the small sample of rexls we have examined* In Mils paper we have repoitcd 
mi four stories and (wo essays (each with Iwo versions), and any llleraie person 
knows llial the domains of stories and essays are very f icli, with many types. We are 
actively pursuing litis issue by examining a much wider range of texts In both 
dioiiaius. But we feel relatively cmifldent t1ia( (lie bmad differences between story 
readersaud essay readers f hat we have described in (his paper ate accurate charac- 
teristics i*f literate leaders. 



Central discussion 

hi this paper we have reported nn snnie results obtained for two simple genres, 
stories and essays. These are genres that are familiar tu any reasonably literate 
reader, such as the college shidenis who served as our subjects^Oor main claim 
alnmt these readeis b that they know, eitlier explicitly 01 tacitly* a number of con- 
ventions for how texts of (hese typesaie written* aitd they use ihis knowledge 
actively during their comprehension nf the text* They have sttong expectations 
ahnu( what Ihey will find in (he (exl, and use (hese expectations to guide their 
understanding. When their expectatiuns are violated, as in an ill-formed story like 
"Wat of (he (musts" or the Ill-formed version* of oor twu essays, (lieh verbal prolo- 
cnls reveal confusion and tlieit silent reading times are slowed down considerably. 
When their expectations are met, as In "Lentil", "Stranger^, or the well-formed 
vehtom of our essays, they appear tu be able to profit f*rom the application of tlielr 
knowledge of genre conventions to the process of understanding. *-> 

A capsule summary of the difference bi strategies for the readers of stories and 
essays might go as follows. The basic orientation of the reader lo a story h prospec- 
tive. The reader is looking ahead, trying to anticipate where the story is going. 
Except at the beginning, where an overall hypothesis b being developed, the story 
reader tends lo relate each sentence to Lite general hypotheses and predictions that 
have been developed. In contrast to this, the reader of the essay appears to adopt a' 
reinfsfHri tive orientation* Each new element In the essay is related to earlier ele- 
ments. There is little sntlcipaiiun of what is coming up, except a( the, most general 
level. This difference In orientation on the part of the reader Is of course due to tin 
hask difference in underlying structure of these two genres. The story has a causal, 
temporal structure, with events ordered and interrelated In well specified ways. 
Furl her* the general schema for a story dictates that the events must unfold accord- 
ing tn a pattern of complication and resolution. These constraints make a predictive 
strategy i|iitte useful. An essay, such as an Inductive argument, lias nu similar struc- 
ture. Rather, a general hypothesis is supported by a variety of evidence, and the 
support relationship between each succeeding piece of evidence and the (usually) 
previously staled thesis makes the retrospective strategy appropriate. It is extremely 
Interesting to us that our readers, especially those in the talkhig-oul-loiid task, 
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exploited these differences in c«Jahlr*hiiif> then overall sliatepy loi t pichcmlorg 

the texts. 

If i Mir Ixillf iirp* out loml ibla aic representative* readeis appear to have consider* 
aide .knowledge ahont both the mulei lying fiiim and surface conventions for these 
simple genres, Tahle 2 attempted lo capture at a general level i lie kind of kimw+ 
ledge lltcy have. Viesmoahly this general kuuwledge represents a kind of geme 
4 schema, and wonkl be applicable tu a wide variety of specific lext types. While the 
schema skelclicd hi tahle 2 hasuhvioiis limits (ejr + it lias limited ntilily Un poeliy), 
II prohahly reflects the general expectations literate people have for many lypes of 
texts. We helieve that our empirical rnvesiigalluris provide a guod slait at discover- 
ing what people know about two simple types of discourse. However, we aie obvi- 
ously far from a complete cognitive theory of genie, In the remainder of this dis- 
cussion we would like to raise four Issues which need to he addressed If we are In 
develop a more complete theory of genre. 

Tlrsl, we need lo characterize in cli more detail Hie principles In lahle 2. l 7 or 

example, what ban adequate formal or linguistic representation of these principles? 
Can we develop i |diu$Jble psychological representation for the principles? Do the 
principles all have the same status? We have ahead y suggested that the principles of 
Couttecthity and Overall plan could be formally represented in terms of, say, a 
story grammar representation (although the specifics and adequacy of such iepre- 
sentalious is a matter of considerable debate). Other principles like Specificity or 
Language do not teem to have Hie same status, but refer rather tu mine qualitative 
stylistic or aesthetic cortstde rations. Specifying the formal and psychological ual-re 
of these principles b especially important if we want to chaiactetlae precisely the 
well-formedness of texls, 

A second bsoe fe how we can apply ur Instantiate the general principles given a 

particular genre. At present the principles have been applied uri Intuitive gm Is. 

using empirical protocols as i heuristic lo Illustrate or suggest a particular for la- 

tioti of i principle for i particular genre. However, we obviously need a mine prin- 
cipled way of applying the principles. 

A third Issue is how these principles are teamed, not only hi children learuuig In 
read and write particular genres but alto bi adults who may have occasion to mailer 
new forms of discourse In a profession or elsewhere {eg* technical forms of writing, 
Instructions, memos, new literary genre, and so on), Presumably, the adult leader 
would bring to bear something like the principles In table 2 and woold Induce frnm 
par I leu la i Instances of a genre liuw these principles are parllc riarlzcd. 

Finally, while oor analysis of written communication examined the roles nf hnth 
the reader and writer* we have focossed in Ihls paper on the reader's behavior. But 
our analysts - In particular, Ihe principles listed in lahle 2 - is josl as applicable to 

the writer. Presumably a writer si learn both the underlying forms for a genre 

and the principles of surface composition. In fad, lit the ahstracl the contrast 
between underlying and surface fnrrns cmrld cnrres|>ond to the geucrarfcm arid the 
revision processes often discussed In connection wllh writing {e.g.. Ciey l 1 )72; 
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I Imw^p ;md ILun l'» / / , (IdmiI mid kid writer untflH In dirfer, In part al 

| c -,st . in cxie i which Ihcy h;<yc aopiiretl Hie principle* nf coiiipc^iliiui fnr 

ihe ^cmcs they td;m Hp wtiie. 1 biwever, ydiile they may have (ncil nihlersliindiiig 
of Hie |Prinri|des in Itieii mle ;is a reader* (hate <l<> mil necessiitity readily triinshle 
i„io i Me* live wiilmg slr.ilepjcs A signifieiiiil pail or Hie writer's (ask is hi he ahtc 
in ;niiit:i|niic llie erievls "f his or her tipni| msiiion on Hie reader. Failure (o dn so 
efleciively usually results in a |khii ctiinprtllion. Similes nT Hie cniikasl helween 
jinotl and had writers, or wrhcr* win* are studying ennipmHlnn, ami or an individ- 
ual writer progressing lliunigfi snevesslve tliiifls might lo he leveling <>r Ihe extent 
hi which ilicse principles play a role in llie writer's task. 

We have hpimd our lalking-ouiJuiMl lask lobe iprtte revealing <if Imlli the know- 
ledge possesseii by readers and ttie processes Ihey employ lo understand a simple 
icxi In ihls pai^r we have only conveyed a very linle nf llie Information contained 

c pnducuh rur Hris task. We believe Hits ieclml<ure lias much pnleittlal useM* 

in fur gaining and understanding of Hie conventions gnvemhiga wide range or lext 
h r e< rrcsmnahly llie lask could be of great ktcresl to scholars or literary pm* 
cew as well as 4how. like us, who are primarily Interested In Hie cognitive pm- 
i rssrs nf milium y readers. 
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The analysis of cognitive processes in r^al time "is one of 
the most methodologically difficult tasks In m \\ of psychology. 
The events we vJ ah to examine are internal to the mind* with only 
occasional observable correlates. Further. Moat cognitive tasks 
involve a host of hierarchically Interrelated Subcomponents* 
likely operating In parallel. Reading text in order to 
understand it is an excellent example of juSt such * task. And 
yet t there, is increasing recognition of the fact that a deep 
understanding of how to assess the readability ol texts and how 
to remedy reading difficulties will require an analysis of the 
process oi comprehension fe.g.. ftlnt'sch t van Dijk. 1977/ Olson. 
Mack/ t Duffy * 1981 > . 

Though many psychological processes important to 
comprehension occur outside of awarenessi any sophisticated 
reader is aware ol much cognitive* activity that occurs during 
reading, with this in mind, we felt that one simple strategy lor 
obtaining, information about the process of comprehension would be 




to have .readers think out ioud vhile reading, we were motivated 
by a 'be lief that intelligent, reading hf a many affinities with 
problem-solving, a domain in which think ing-out- loud (TOL) 
protocols have proved to be a useful research tool <e.g<» Newel 1 
t Simon. 1972). Of course, to use TOL data to study cognitive 
processes*, one must be a'jare of the limits and pitlaUs of this '* ^ 
method, As with any other method, it is useful for pursuing some 
goals and not others. The aim of this chapter is to discuss its 
usefulness as nne technique for studying tne comprehension of 
connected teat . 

This chapter is organized as follows. The general rationale 
for the use of the TOL method is described first. This includes 
a discussion of a general model of comprehension that has guided 
our research and our use of this method. The goals of the TOL 
method and the general assumptions made in using it are 
described. Heat * we list a variety of different types of TOL 
tasfcs that. can be used* and briefly discuss their virtues. Then 
*e illustrate the use of TOL data in the analysis of 
comprehension processes by discussing a series of studies 
conducted in our laboratories* We also describe a series of 
other applications of the TOL task to make comprehension 
activities explicit, though in Some cases as a means to another 
goal. Since other investigators have used the TOL task with more 
mixed results than ours, we discuss some of the reasons why the 
TOL task may vary in its usefulness. In the concluding section, 
we summarize in a convenient form the advantages and the 
limitations of using TOL protocols for studying language 
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comptehens ion . 

*. 

K THE USE OF THltlfUHG-OUT-LOUD PROTOCOLS 
what kind of inEormition can w« hope to obtain from, TOL 
data? There has been much controversy In the history of * 
psycholo^Pt^taut ^verbal reports as data, (ocusslng primarily upon 
their oft-reported unrel lebi 1 i t y (e.g.. Hi abet t * Hilson, 1977k 
In a detailed analysis oE verbal reports as data, Ericsson and 
Simon ( i9B0 ) clarified several points about their use that art 
important to keep In mind when tfelnking about TOL data. First, 
the locus of the TOL task should be to get subjects to'report the 
content oT their lmmqdiste awareness rather than to report 
explanations of their behavior. Further, subjects Should be 
asked to report what they are thinking about right now* not what 
they remember thinking about some time ago. The TOL task should 
also have subjects talk about sspects of their Immediate ' 
experience that they.carf talk about. Some processes are 
unavailable to Introspection or are difficult to veYbsllzs. In 
general, limits on what is available to he reported upon, what . 
can be remembered, and on the human ability to offer explanation* 
or justifications for one's own behavior should be respected. 

Furthermore, TOL data should nt>t be taken as dixect 
reflections of thought processes but rather as data which are 
'correlate^ with underlying thought processes. T0£» data provide a 
sample of what's on the subject's mind during the task. But they 
will not necessarily reveal the strategies* knowledge sources, or 
representations actually used. These theoretical constructs must 
be inferred from th* TOL data. The situation Is quite analogous 



to the use ol eye movements or reading times in studying 
comprehension. He are less interested in the statistical 
properties oE eye movement* ,or reading times than we are in the 
comprehension processes which generate these properties. These 
processes must be inferred from the data. .TOL protocols are no 
different. They are unlikely to reveal in a direct fashion the 
underlying processes we are most interested In discovering. 

These cautions are extremely important! for as Ericsson end 
Simon potat out In some detail? many of the criticisms oE 

verbal reports as data are based on faulty assumptions about the 
treasonable uae of such data. As wlfh any other format data we 
collect in cognitive research* TOL data provide indicators of 
resl-time processes thst must be affirmed through the examination 
o't as broad a range Vf different measures as possible. Of 
courser as with any, other type of data* 'TpL data have a number oE 
limitations which muat be keep ^fr^ml nd. Ericsson and Simon 
( r l9BtfF present a clear discussion oE 1 the virtues and limits oE , 
TOL data in general, a^d this chapter will attempt to do' the same 
for the specific esse of text comprehension. 

Reading involved a broad array of processes, from sensory 
and perceptual ones to^higher level processes such 4s reasoning 
and Inference. Table I presents s partial list of these. The 
perceptual, attention* I, and »e«o<y processes' Involved in the 
recognition of letters sJPd words "E or a skilled reader occur too - 
rapidly and may not be available to consciousness. There are a 
variety oE experimental procedures available for the analysis of 
these lower level processes.. Such processes aa the syntactic and 
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semantic anslysis ol sentences may or mny not be usefully 
analysed by TOL methode. But the TOL task ts> best used to study 
the higher level processes in reedingt tht inferences^ 
predictions, scheme elsborat ions , and other complsx cognltloftS 
that occur Si pert ot surfed rssdlng. We sssune thess procssses 
sre most evaTlable to conec loueness ss tht reader reads. The 
outputs of thsse processes srs verbal* slow to arise* snd ssmples 
ot them sre sufficient tor the Invsstlgator to Inter what siust 
havt trsnsplredp In genertl* to the extent thst one sgrsss with' 
Nelossr's 1:967) chsractsrlsst Ion of resdlng ■■ "ssternslly 
guldtd thlnklnq |p* 1 J6l , * £hs TOL method Is speclsllxsd tor ths 
study of the thinking* ■ 

Insert Tsbls 1 about here , 

The Investigation ot reading processss csn begin many 
ways. Hany hsve started with s lormel snslysls of the metsrlsls 
themselves. Those lntsrestsd In lettsr or word recognition 
sttsnd to the frequency and rsgulsrlty of various' Items In 
typlcsl text . "Fhoes interested In syntsctlc er^iyelS turn to 
linguistic theories of sentence structure for hypotheses. 
Fina'llv* those interssted In test levsl vsrlables look to 
linguistic Analysis for descriptions of Inter-sent encs phenomena 
like anephors or of the overall structure o,f texts. The 
information gleaned from such formal anslysqs of the properties 
ot print and test is very Important to ths anslysis of resdlng* 
and In combination with ssSumptlonS about psychologlcsl processes 
provides a rich source of initial hypotheses ebout aspects ot the 
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resding procsss. 

Formal snalytes ot the properties ot print and test ars much 
less useful in formulating hypotheses about the higher level 
proctSses--the thinking-- thst occurs as part ot skilled reading. 
Further* although many ot us are ewers of tbe thoughts we have 
while reading* It is dlttl/ctfft to enslyxe these processes either 
on ths basis ot Introspection or (roe* other a priori 
conslderstions* Ths TOL task offers an opportunity to collect 
systematic observstions sbout the thinking that occurs during 
reading* allowing the Invsstlgator to form hypotheses ebout this 
level ot processing which can In turn be evaluated In a number of 
wsys. Including » eeper lmentel tests* Thus* the optimal use ot the 
TOL tssk is ss a discovery procedurs tor studying thsse higher 
level proceeeee* 

In order to better appreciate what might be learned about 
the compreheneion proceas from TOL data. *** begin with a briet 
eketcti ot the neture ot teet compreheneion. Figure 1 showe a 
schema for whst Is Involved In reeding, focussing on the higher 
level activities* The tocus Is on what the reader le doing at 
eome particular point In the test* Whet controls the rea.der'e 
thought processes at the point where sentence H in s test is 
being read? It Is controlled by the etructure of the test and 
.sentence N's pertlculer role in this structure. And it is 
controlled by the reader's knowledge of tftt world--both physical 
and social—that plsys such an importsnt part In language 
understanding in general* Further; It IS quite clear that 
skilled resders possess knowledge ebout' teit cpnventlons* ebout 
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^ow tetts sre written in order to eccomplleh what they perceive 
to be the author' ■ goele taaa Oleonr DyMy t t Hack* I960; Oleonr 
Hack, * Duffy, 1901 J > 

» Insert. Figure 1 about hara 

'iTO'theee general eourcee of conetralnte ara rdded three 
typee of knowledge conetructed by tha reader during 
coiaprehenelon. Tha flret la a representation of vhat haa baan 
preeented In tha test ao far. This la typically organised by a 
schema appropriate for tha tsit type balng rssd. Sscond, a 
workspace containing currant llnaa of thought tha Feeder la 
working on la conetructed. In etorles* tha workspace ftf-ght 
contain hypotheses, about vhara the tsst la heading. For 
argumentative sssays or journal articles* tha workspace night - 
contain criticises of the suthor's arguments* Tha contents <>' 
the workspace can ba more or lata Specific depending on 4 variety 
of reader and teit verleblee <»,g.* Oleon et el.t 1961)* but they 
ere en Important part of what moat ekllled reedara *re doing In 
eny teat. Finally, e^|hough It hee not yet, been etudied In much 
detail by cognitive peychologlete, readere probably construct e 
pod* ^ of the writer * tha other participant In the eoclel 
intercourse being tnedieted by the text. The reader' a aiodal of 
the writer may not be accurate, and may vail be manipulated 
Intentionally by the writer. 

♦ 

k reader faciqg eentence H In 1 test wil.1 ute these various 
aourcaa of knowledge along with e ftemant 1c repreeentet Ion of the 
Sentence to modify each of the three repreeentetlont being \ 
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conetructed durlrvo, copprshsnsiont the repreaentet Ion of what haa 

V 

bean reed* the repreaentet Ion of hypotheeee* end the 

1 

repreeentet Ion of the writer, For conceptual simplicity «e 
Imagine thet a eentence thet haa already been given a semantic 
repreeentet Ion le paeeed on to thoss processes most directly 
concerned wlth'thl y s updating ttls Ignore the undoubtedly Important 
interectlcne between thete updating proceeeee end the lstUslr 
syntactic, end semantic enalyftee of Individual ssntsncssJ* The, 
majortfocus of the TOL dete will be on the proceeeee responsible 
for integrating the eemantlc represent eh Ion of en individual 
sentence Into the verloue cognitive etructuree being conetructed 
during comprehenelon. Theee dete ehould reveal the kinde of 
et re tea lee ueed b« reedfre In eccompl letting theee teeke, the 
kinde of knOwledjj source e employed, and the kinde of 
repreeintetloni conetructed. while memory meeeuree^ like recall 
heve provided ueetul Information about the knowledge tourcee end 
repreaentet iona ueed In keik comprsrienslonr they tell us vary 
little about the ttreteglee employed or about the ssntencs~by- 
sentence Interactions smOng tha knowledge eourcee end 1 

repreeentet lone. * 

^\ 

7. TYPES Of TULRlWG-Otrr^tfOUO TASKS 

s * - * '' 

There era etany kinds of TOl> deta thet can be collected for 
atudylng test comprehension*. " In this section «e will review 
seversl^mejor types that haw* actually been used* and briefly 
discuss thslr virtues and Unite. 
I . Sentence'by- eentence teJLfclnj- 

In this version of the teak* which could be considered Its 
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ftr.nt hatlr tnrm t t *i>hj^^t it ssksd to t • * It s'ttr tarn ttftrtnc* 
ut 'fit t**t. The t t iring Continue* until tht rtit it compitttd. 
Tbnii^h in principle tht ttut could bt prttenttd In tlmott tny 
f«»hionf mutt lnvttt Iqttort htvt prtttntert It in tuch • way that 
H>* rtad#r ra»>.>ot lodfc ahttd . Howtvtr , I nvttt rgstors htvt vtr ltd 
rh# . #iit#nt to which t he reader can loot btc h tt previous ts*t* 
Th* mott restrictive prtttntatlon mates only the cdrrtnt sentence 
fivmUbl*, while tht lesst rsstrlctlvs mskes til tht pre v tout ^ 
cent available* vsrlous wlndovs ot 1 n 1 1 rmsdi t tt tilt could alao 
bt u4sd* Hon exactly to organ l it tht prtttntttlon ot tht teat 
dtptnds somewhat on tht got It ot tht lnvttt Lgstor . Tor instsnca* 
in much of our work wt htvt been inttrtstsd *n • t*pl 1c 1 1 lng as 
fully at pottible tht rolt ot tht currtnt atnttnct In 
comprehension . This htt ltd ut to *>se tht Mngl t -sentenc t 
exposure most frequently* but other arrengsmants ctn b# essily 
justified. 

Another dlmtnslon of varletlcn It what tht reader a ara tskad 
to talk about. Wt havt used two typ*S j >of Inttructlona In our 
work j 1 

a. Qan ara 1 Instruct lone * In thlt version ot tht tttk* ft 
encourage subjects to tal* about a widt rang* of thinga* 
However, we typically glv# tht* a list ot tiampltt ot tht types 
of things we would like them to talk about. tttl It It 

Inadequate to instruct them to "think out loutf* without telling 
them what this means* at least In tht content of ttudytng 
comprehension * 

We have done several studies In which we ssked Subjects to 
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think out loud generally tt*g<* Olton tt tl . * 1901). Map \n 

mind thtt thttt tubjtctt trt ttlHng ttttr ttch ttnttfict In th* 

tt*t. Tht kinds ot things vt ssksd thtm to ttlk tbout lncludt<1 

tny Inlarencnt or tltborttlont they ttlt compellaa) to drav on rl** 

baslp ot tht current ttnttnct, tny conntctlont thty ttw bttvttrt 

tht currtnt stnttnct snd tny prior ontt* tny prtdlctlont thty had 

sbout iihst might bt cowing up, snd tny comentt they htd about 

what tha'f ttlt waa tht rolt ot the currtnt ttnttnct In the 

ovtrtll organisation of tht tatt . Thttt art obvloualy not the 

only thtngt aubjt^tt could tall about, Wt included thttt btc am* 

thty wart ot thtoretl£sl Inttrtst to us. The Important point 

w 

vla-a-vla rha utt of tht TOL task to ttudy comprthent Ion It that 
ont bt tipllclt with tht tubjtct about what to ttlk about. Tht 
attct Utt ot auggtttlona thould be motivated by thtorttlcal 
ident or by prior reaeerch. 

b. Toe Utt ad instruction* , tn thlt vtralon ot tht TOt ►•sit, 

tht subjtct tt Mktd to tallt about onty ont typa ot thing or to 

i 

do ont type ot activity. Ltt ut Uluqtjratt thlt with two 
eiamplee frost out* Own rtattr£h. tecautt ot our intertat In 
prtdlctlvt proctttln9, vt have collactad TOL dttt In which all ft 
aaktd subject* to do was to mailt predictions sbout what was 
coming up In tht future tn this ts*t snd to comment on tf»e fate 
of earlier predictions if thty tsjt this vat werrstited. Clearly, 
this task wss motivated by a special theoretical concern for the 
importance ot a particular type ot activity. Earlier data from a 
-general TOL task hsd indicated that predirt ions might be sn 
especially informative rind ot activity (Olson et el.* l98lh so 
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**nr*f1 fn%)l lii t ■ rifhii lit of prfltctlon dirt thtt wt hid 
.ibfaif»#i1 from t hi rjinirtl tttkr whtrt tuhjtctt ttlhttd thout ■ 
finitfitr oT r1iff*r*nt typtt ol thlngt which cMtptrid with 
\n »d I ■ r tpril . 

In • ticond ttftnplt* »• htd tubjtctt tttt qutttlont tfttr 
r#Af1iri9 llrh itnttnct. Thty wtrt told to Ifttglnt thtt tht tllt'l 
inthor **t prtttnt. md thtt tht tuthor willing to tntwtr any 

fjiiwition tht rttdtr l*td tbout tht tttft it thit point; tNctpt for 
rh# t>b<stout qutntton of whit co*ot niNt. One ■ tgttn v wt hid ■ 

( f I c thtorttlctl gotl In uttng t hi ■ ttttt* At with tht 
tjtftipl* of pndlttloni, thttt klndt of qutttlont occttlontlly 
*ftf>»«rtd tn tht ion gtntrtl typo of TOL ttttt* but wt wtnttd ■ 
rirh*r ttt of dttt thin wt could gtt whtn ■ vtrltty Of dlfftrtnt 
ryp#i of Inforntt Jon wtrt btlng collected. 

Both of thett titmpltt thtrt ttvtrtl Iftporttnt proptrtltt. 
Pint, tht ttltctlon of tht thing to bt ttltitd tbout 
theoretically *otlvtttd. In both ctttt wt hid • background of 
1#n»r»l TOL dttt* rffdlng t In* dttt. end thtorttlctl aodtlt fro* 
rihi^h *t trrlirtd it tht fptclllc probtt wt uttd. StCGnd, tht 
main riBSon for uilng lb* focutttd TOL tttk wtt to gtt richer 
data about thit ptrticultr dttt typt . TOL tubjtctt will only tty 
much, whtn you h*t>« * vtrltty of typtt of thlngt for tht* to 
tnlfc nbouC , you wilt only gtt t modtst •mount of tny ont typt. In 
ord*r to gtt richtr dttt of t tptc I f Ic typt tht focutttd tttk tt 
n#td#d. *iit btrtust tt It focutttd It provldtt * Much ntrrOwtr 
window Into tht proewss of comptthenSton* Lttir. whtn w§ dltCutt 
an titmplt of this methodology in more dettlli vt will rtturn to 
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htvt both uttd t TOt ttttt In which tubjtctt tntwtrtd tptclflc 
qutttlont tfttr ttch ttHttn^ of t ttjt. Pumt lhtr t ' t tubjtctt 
tntwtrtd, f Ivt Ifh^qutttlftflt (who, vhtt,'wh«, vh«n. whtrtl tfttr 
•tch ttnttnet* Tht ttttt bt^tn tublguOutly, with ttch tuccttitv* 
itnttnet providing tddttlonAl conttrtlntt on whtt wtt going on. 
flufttlhtrt uttd tKt TOL ttttt to dttcovtr how tubltctt dtvtloptd in 
InttrprttttlOn of tht ttttt tnd how tht Intt rprt t ti l*« chtngtd 
with ttch tddltlontl ttnttnet. Qrtttttr htt uttd t vtrltnt of 
thit ttttt (tubjtctt tctiMlly wrott down tt>t1^ tnt^trtf to 
Invtttlgttt ho* rttdtrt conttruct t Ttprtftnt 1 1 Ion of tht ttttr 
focuttlng on tht contribution ttch ttnttnct^Mtttf t to tht growing 
rtprtttntttlon. 

Ttt tnOthtr vtrlatlon on tht TOL tttk 1ft to ht^t tub)«ctt 
ttU tt Only pftrtlcultr point ■ in t tt*l. Thtrt trt two brotd 
clttttt of juttlf Icttlont lor thit. rirtti on* mmj htvt t 
procttt tlttory tfktt plnpolntt ctrttln plictt In t tfftt tr 3 crucial 
Itttt of tout ttptct of tht theory. Stcond, In dttlgnln^ 
Mttrltlt for tn t*ptrl»tnt, thtrt mmj bt ctrttln proptrtltt oo# 
wtntt to htvt tt ctrttln polntt In tht tKptrlMnttl ttitt. A 
ttltctlvt TO[* tttk ctn bt uttd to vtrify thtt tht tmttrltlt fctv* 
In ftct Intttntltttd thit proper ty * 

Btctpt for tht ftct thtt It Itfttltc t Ivt rtthtr thtn 
ttnttnet-by-ttnttnet for tht wholw twnt # tht tarlitr ditcutttonn 
• bout whtt to htvt tubjtctt ttlk tbout hold for this , vtr Itt i ¥ on 
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the task too, W* would Especially Ilka to undersrore the use of 
this version of the TOL teak for preparing stimulus materials for 
experiments* In most, studitt ot text ptocessing, the ma^or 
Independent usriablea art man lpul tt Ions of tht teit. We have 
found through eitperitnce thtt what tttm to bt insttn t tat i^ns ot t 
tent vsrisbie are otttn not good axesrplea ot it. Using aalactive 
TOL to aid in developing tht Stimuli has besn s major part ot 
several atudles *s hsve dons, Tht faedbeck trow subjtctt who 
think out loud Is axtramely informative, so much so in fict that 
wc have bagun t whola line ot rsstftrch aimed at jaing TOL dsta ts 
tools tor providing feedback to writers* wt will diffcuas this 
last exampta later , 

fn general, stlecttvt talking Is uaed to study what 
processing is like at tout particular point. However* to asstss 
tht role of local contributions to tht talking vtr tut global 
characteristics ot the tslklng, tht plscsment of ' control ptobes 
st points In the t«*t ditftrtnt from thost of specific Interest 
is important, A varitty ot theorttical ronsldsr tt Ions would 
determine where to put such control probes, but they are s 
necessary part of the ust ol selectlvs talking, 
Ll After the tact taUtnQ , 

Ericsson snd Simon i t900) correctly ttress thst It la ris%y 
to ask subjects to talk about their cognitive experiences afttr 
the fact,* Memory is too fallible to allow tor accurate reporting 
of earlier stent sL states , Howevet , It very shott texts or text 
fragments were used, the memory ptoblams art not as great* and 
useful TOL data could be collected after the fact. 
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Collins* Brown, and Larkin <19Q0> used just such a task to 
examine the general strategies used to comprehend short texts O 
an<4 A sentences long)* The texts were difficult to understand, 
and subjects were asked to talk about the hypotheses they had 
considered and rejected in trying to Interpret the text* Because 
the texts were short, subjects could remember intermediate 
interpretations they had generated while reading. This method is 
tess useful tor eiploring the presetting ot longer texts, 
especially if the investigator Is concetned with evaluating the- 
contribution each sentence stakes in the comprehension process. 
Even with the short texts used by Collins et al,, It is not clear 
how accurate subjects were In pinpointing exactly where a 
hypothttis wss introduced or rejected. 
Summery 

Our descriptions ot dittertnt TOL tasks in this section by 
no means exhtust all ot the possibilities, Rethtr, these ahould 
be taken ss suggestive ot the Mnds of ways in which TOL data can 
be collected to be used to expllcatt the nature of comprehension 
processing, Ont't specific theoretical and empirical goals will 
dictate which variant of the TOL task will be most useful, 

J, EXAMPLES OP THINKING OUT LOUD DATA 
tn this section we present some example* of the use ot TOL 
data trom our own research, We present an example of both the 
general TOL sen tence^by ^sentence task and the totussed sentence- 
by-sentence question-asking task, 

Sectence-iiy- sentence TOL for simple stories and essa ys . 

These data, reported in more detail In Olson et al , <l90H, 
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illustrate the use of the general sentence - by- sentence TOL task* 
W* had subjects think out loud while rending four different 
stories and [our different essays* 1 We used tvo veli-formed 
simple storlesi Lent j 1 snd St ranger * and tvo stories that 
violated certain conventions of story telling. These latter tvo 
stories were Circle I si snd * Dawes' \ l4$$) story thst was used by 
Thorndyke <)g77) to Study story processing* snd war of the 
Ghosts * Bsrtlett's i 1932) classic* W* chose Clrcls Island And 
War * of the Ghosts becsuee ve vanted to be able to contrast TOL 
data obtained from veil-formed stories < Lent 11 and Stranger ) with 
^se tvo ill-formed stOrfes* A different group of subjects 
talked out loud to tvo versions of each of four different essays* 
We present the story data In pore detail here* ao wfll not 
describe the essays or thair data as completely Ises Olson et 
al., for details)* 

t It helps to have a sense of vhat TOL data are like* Thus* 
in Table 2, ve present en excerpt from a subject talking out loud 
to the first 17 sentences of Lentil fall of Lentil is shown In 
Table 3)* These data are typical of vhst a skilled* educated 
adult reader talks about vhlle reading a story of this type* 

Insert Tables 2 and 3 about here 

We have used protocol dats of this type in tvo genftrsl ways. 
First* ve have obtafned qualltstlvs Impressions of the nature of 
comprehension processing for various types of texts* Second* ve 
have related quantitative properties of the TOL data to other 
types of data* such as sentence-by-sentence reading t^itnes and 
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recsil data. We give examples of each type of analysis here to 
lilustrste hov TOL dats can be used* 

Oualf totive analyses* We fo^us on TOL data obtained for 
simple stories* what la a reader doing while reading such a 
te*t7 The reader is confronted vlth the following task. A tent 
embodying various aspects of the story is available as input* 
The tea* vill be processed against a background of several types 
of knovledge that are relevant to it* The final product of 
understanding vill be an interpreted representation of the 
essential elements of the jjtory* Hovever* vith most stories, 
this representstion must be constructed from incomplete J 
information in the tent* Much that is Important to Interpreting 
the elements of the tent as s story Is left Implicit* 

We can make this more concrete by describing some of the 
properties of TOL data for readers reading simple stories* Table 
4 presents the relative frequencies of different types of things 
readers talked about during the four stories ve described 
esrller* As Is evident* most of their tslklng is devoted to 
making inferences* generating predictions, and commenting on 
connections to prior information. This follows from the stress- 
ve gave these three categories of information In our instructions 
to subjects. The relative freguenclee of these activities are 
roughly the same serosa the four stories shown In Table 4, though 
there sre some interesting exceptions that are discussed In Olson 
et*al* (t9Bl)* Though comments about the story or about their 
ovn understanding are lov In overall frequency, they are very 
diagnostic of aspects of stories that readers are sensitive to. 
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Insert^Tsble * about here 

A portrait of story processing is revested by rssders 
reading a well-formed story* Lent U (see Table 3>. This is a 
straightforward children's story whoss orgsnisstion is quits 
simple. Ths first IT sentences introduce the thras major 
characters and lay the seeds of ths later conflict among them. 
The detailed actions of the story begin st sentencs 18, and the 
climaMthat distinguishes the^co»pl ics t ion in the plot fro* the 
resolution occurs during sentsnces 30 to 32. Our analysis of 
whst readers are doing while rsading Lent Is bssed on 1J 
subjects who talked out loud during it. »e vers especislly 
concerned to identify aspects of their tslfclng that vsrs common 
across most of the group rsthsr than ldiosyncrs t ic to individual 
subjects. v * 

Throughout ths first IT sentsncs* ths subjects wers, clearly 
collecting information and torstuls|ing tentstivs hypothesis sbout 
what was likely to happen In ths story. They all recognised that 
the three central characters yield a highly probsbl* line <>* 
conflict and resolution. Two will be- in direct conflict* and the 
third will produce the ultimata rssoluttoty. At sentences IB snd 
19. where the detsiled action of the' story . begins * the subjects 
brought together their tentative hypotheses and formulsted 
general plans for the rest of the story. Table 5 shows soa>e 
ettamples of what subjects ssid at this point. It via striding to 
us how regular this phenomenon wssi virtually ill subjects did 
the ssme thing at about the same place in the story. 
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Insert Table 5 about here * 

Throughout the processing of the main part of the story* tha 
hypotheses constructed by the subjects were much ^evidence* 
each event was incorporated into the gensrsl plsn constructsd at 
the end of the sentence 17. The impact, ot thsse hypotheses was' 
most dramatically revesled at sentences 50 snd 31* where the 
climax occurrsd. The readers were 1 csrtsin that something was 
about to happen, but wire uncertain as to ettactly whst. 
Consistent with 1 ths eipectation that a story' contains^ novel 
elements* the reedjere ettpected to be surprised by the specific 
form of ths complication, even though they knew it would involve 
t«o particular cherectere* The first sentence of the climax Is 
totally surprising* yet subjects Immediately knew that the climate 
must be at hand snd thst the third character is about to 
intervene to sevs the day. This is %i\ thi more intereattng . 
because the third chsrscter has not been mentioned for 16 
sentences* Subjects sre lad to eipect that ptople sre mentioned 
in s story tor a resson. Whin a chsrscter is not brought in for 
a while* ettptctetlons of an appearance grows* The .resders are 
anticipating a plsce for the character to fit in* Because the 
story la well written* at least by the conventions for children's 
stories* the predictions subjects make in response to the 
climactic event are in fact right. 

Once the climai *e passed* the mode of processing chsnged 
quite drastically. The readers appeared to be operating in a 
confirmatory mode. Ho new surprises were expected* Over and 
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•over one finds in the protocols statements like "That's what 1 - 
expected,* or p Yup, p indicating that predict lona generated were 
now being found to be congruent with the emerging detail 9 of the 

post-climact ic part of the story. 

* 

Lentil is a goo*d example^of s story where the writer snd the 
reader are operating in harmony, and the TOL data give a clear 
picture of how this works. The sarly part of the story sets a 
background and leeds to hypotheses which successfully guide the 
subsequent processing, ''The eeme etpftctstions «r« derived by 
different readers st jutt about the ssme points In ths story, and 
specific events tend to be tqtsrprsted In ths seme w*y. The 
rlime* is especially striking. Though It If unpredictable* It is 
Immediately Interpreted by all subjects snd is Integrated into 
the general^rsprss^ntat ^on being constructed by the reader* T 

In Olson st aK U96l^ we'dlscues differences between the 
processing of Lent|l *nd the ill-formed stories »e Invest igatsd . 
Wese contrasts sre especially informative In helping us* 
construct ths portrait of processing jutt 'presented. By seeing 
what Subjects do when things are not working well* wa obtain a 
clearer picture of the kinds of strategiss subjects ere^ trying to 
employ while reading. - ^ 

Because they are written and read tor di f ferent purposes, 
one would eipect stories and argumentative escays to be read in 
somewhat dlt ferent ways. An analysis of TOL data tor stories end 
essays confirms, this. Table 6 shows the relative frequencies of 
types of talking in the TOL dats tor two versions of two ot the 
ees»ys »e used* The greater frequency D t Comments on Structure 
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Is due to our Instructions: »e added this to the set of things 
*»e stressed to. our TOL subjects. 

* Insert Table 6 about here 

The eummery dsta in Table 6 do not xevesl* some important 
details regardlng*qualitetlve differences In the processing of 
stories snd essays. Perhaps the most dramatic difference cones 
In the hinds ot predictions made by reader*, The typical 
predictions made by a reader of a story sre specific. Subjects 
predicted events that might occur later In the story, involving 
specific characters. The examples in table 5 are typical. The 
Specificity ot the predictions Increased as the story developed, 
but even very early In the'Storles the predictions were 
remarkably .specif 1c. Those In Table. 5 occurred less than » ^hird 
ot the way Into Lentil * fn marked contrast* the predictions 
given in the esssys^were much more genersl. They often consisted 
of comments to the effect that thereeder expected to see another 
argument or another etemple. But the specific content ol the 
argument or etample was usually not predicted. This difference 
in the types ot predictions genersted by readers reflects some 
Important differences In the way they approach the two tent 
types. The readsr astory haa a set ofei firm expectations 
about the type ot substantive events that will constitute an 
acceptable continuation of the atory. Given background 
Information about tHe charactera and their motives'* much can be 
anticipated 'about how the conflict in the plot will arise and how 
it will be resolved. However* for a typical argument It Is 
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apparently more difficult to predict the specifics. Readers fcnov 
that en Indurtlve argument will hive various elemenfce of 
supporting evidence tor the main point* and they know thet^a 
compare end contract: essay if 1 11 mrke comparisons and draw 
rontraats. Buj^ their expectat lone 'dfo not reedliy transiste into 
specific predlctjone* For eeempla* Table 7 givee typical ' 
predictions generated by reedere et the end of the first 
paregraph of the well-formed version ot the Ce rpet I ng essey (the 
complete eeee# ie in Table flj tht first paregraph * n ds at 
sentence~^K Thle paregraph presente eome becfcground ^ 
Information* introducee the theele ot the eeeey, and ennouncee 
that there will be three Jrgutiente made. In eupport 6f the theele. 
In contrest to the 'predict ions given at the end of the background 
section in LentiW eee Teble 3)* the eseay raedere do not seem to 
go beyond whet the author hee toid them about the arguments to be 
presented / 



tnssrt Teblee 7 snd 9 sbout hsrs 



ghile the predictione in the essay TOL dete vera not as rich 
as those tor storiesi the comments on essey structure were 
extremely Informative. Theee comments revested subjects' + 
expectatlone about ho* an essay shouid be written. For example, 
our readers expected to find e topic or theeis sentence, end they 
expected to find it eerly. In one version of our eesay on the 
coming ice age* we deliberately piaced the topic sentence iete in 
the eseey. As a result # pieces of evidence tor the coming ice 
ege were presented before the author announced the main point. 
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When reading this essey* many TOL Subject s expl icit iy searched 
for the topir sentence and cornel eined that the author toofc so 
long to come to the point (eee Table 9). in the Carpeting essay, 
subjects revealed e eensi t.i vl tjS^to surtece signalling devlcee. 
For example* In reeponee to e sentence that begen with the phrae* 
'In ehort,* eubjecte predicted that the writer would no* move on 
to the next point in the argument, when *e preeented subjects 
with a verelon of this eeeey with euch eigneiiing removed, «e 
found evidence of contusion In the protocole. 

Insert Table 9 sbout here 

In short » the reeder oi an eeeey hee generel expectations 
ebout th>e overall etructure of the erguewnt or thesis* The 
reeder quicJtiy recognizes the type of point fping wade< end et a 
general level le eeneltUe to the organising devlcee In the 
surtsce structure at the eeeay. However, unlUe the etory 
reader* the reader ofcen eeeay does not appear to e^gege In rich 
hypothesle generation and teetlng. The reeder seeme to edopt e 
- more pseelve etretegy* weiting for eech %^ Item of Informetlon 
to-be preeented end trying to tit It Into the overall scheme ot 
the argument. 

A capsule eummary of the differences In .streteglee f for the 

readers ot stories end eseays might go ae followe. The basic 

> 

orlentetlon of the reader ot a Stary Is prospective. The reader 
Is looking ahead, trying to anticipate where the story Is going* 
Except at the beginning, where en overall hypothesis is being 
developed* the »tory reader tende to relate each -sentence to the 



<|fiitr«l hypotheste end predictions thet hsve biin dsvtloped. In 
-retreat, the reeder of the titty adopt* t . a retrospective 1 
orientation, Each new element Jn the e»eay it related to tirlitr 
f l«»iptnti, There it little anticipation ol whet it com 1 09 up* 
except at tht tiott general level. See 01 ton et el. (i960) end 
Olson tt ti . . ( 1 98 1 > lor t acre detelltd discussion of thees 
differences and thtii beels In the netUrs of tht t*o gsnres. 

Quant i tat i ve SnelySee . An obvious qipstlon it *hsther tht 
date obtained lroe> • TOL teak bsvs tnythln9 to do tt til *ith 
reading *hen not telltlng* There «rt csrtslnly siany pecul it r 1 1 i tt 
of tht TOL situation thtt could dlttort tht processes uttd by tht 
reader^ and thus 9ivt us • Itltt Iftprssslon of whet it occurHn9 
during reading. Thtit trt ntnf *eys In which thlt could bt 
assessed. In esssnce* ont wSritS to Ses H properties ot tht TOL 
datt tn any way relet* to propertl'ee ol rttdlng under other 
sjtuetJone. 

wo htvt eaSetlned thlt by carrying out pultlplt rt9rtttlon 

analyses ol TOL dele* using properties ol tht TOL dttt tt 

* 

Independent utr tablet and ssntsnce-by-sentence rttdlng f ines 4* 
dependent variable** Ha msasursd retdln9 tletee by hevln9 tn 
independent group .of eubjecte read each text at t computer 
terminal. 'Each tine thsy Preeted a hey tha next tentenC* of the 
text appeared. Only ont ttnttnet wss shown tt a time* /Subsets 
vers told to read the text tt nOi*ally at possible. Those 
reading the stories *ere told thtt later *e would explore how 
well they understood each story. Esssy readers were told they 
vould latsr have to write a one-sentence eumetftry of etch essay. 
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The primary 'datt troe> thlt teak trt the tlm eubjecte devote to 
reading ttch ttnttnet of etch text. ** ^ 

Fi9urt 2 ehoee tht rttdlng rtttt for ttch esntence lor t 
group o I 12 aubjtctt rttdlng Lentil . Tht nessurs of rssdlhg rare 
on tht ordinate tefcee Into account dllfartncat In ttnttnet 
length. Though thtrt are Interesting connactiont bat* Han tht 
qualitative picture ol ttory proceeelrtg rtvtaltd by our gtntrtl 
analysis of tht TOL data and tha prof lit ot reeding tis>es in 
Plgurt 2/ he^e «s *ent to focus on the quantitative tntlyttt. 

* 3 r 

tntert figure 2 about htrt , * 

A Sttpvitt etultiple re'greeelon vtt perforated* uting eteer> 
reeding t 1»# per eentence at the dependent variable tnd a ter lea 
ol Independent variable*. We fOCue on tha ttorltt first* for 
tech ttory* two analyses *e/e done, one thtt Included^ sentsnce 
serial position and ons thst did not* Tsbls 10 shows the general 
results (ses Olson et et., tWi» for the specific regression 

coefficient*)* This tsbls lists the predictors selected by the f 

w 

stspvite regression tnd tht cwauletive vtrlsnce accounted for for 
each of the two Snslyess lor ths four stories* Note thet for 
both Lentil end Stranger * our t*o * el 1 -I orated etorles* the 
relative frequency of various TOL cttsgorles SccountsA for 
slgnlttcsnt portions of vsrlsncs Jn ths reading tlewfc, when the 
effect of sentence length haa been repoved te a separate fector. 
Mote aleo thet aerial poaition and predictions are independent 
variable* that ere correlated with each other. When serial 
position is e*clude4 fro* the analysis* predictions takes its 
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[iIas* *e • piarilrrm rfl Hiding t lihii . The teee ie Moil Mined 
t tu thn HI fnnid ernrlee, Only eentence length predlcte 
r»*4»n(] Hmee fnr C jjx ll lllin^ w h 1 1 ■ only one Minor cetegory of 
nil* piodnrtlnne eccounte for eny portion of t hi verlence in 
rfttdlncj tlnee tor Wf£ 2i th l fc&lll* dete * 0r the^well- 

foi*e<1 etoriee ere quite clur, Plecee vhin eublecte in the TOL 
tuftfct generete 00 re telfclng. eepecielly predlctione end 
i i>l«i (nc«i< ere thl eeiee plecee whirl independent eubjecte elow 
4 own while reeding ellently. Tht • eupportft thl cllli thet the 
TuL tfnte ere releted In *n Important v ey to whe t reedere ere 
df>i^g during wore ordinary typee of reeding* 

Ineert Tib It |Q ebout here 

A quit! dlffinnt picture eeterged for tht eeeeye* Multiple 
re^reselone of reeding time date for tht eeeeye reveeled no 
i«lat ionehipe betwe^ the TOL dete end ateen feading ti»va* The 
only vtrltblt to emerge •• • eignlficent predictor wee eentence 
length* Thie it in parked contreet to tht •tor? dete* where 
««T/«ral Iridic «» ot TOL bahevior correlated with tht raiding 
tlmee/ This is yet enother indication of tht dlfferencee in the 
b#H«vior of the t»o groups of eubjecte* 

One other difference between etory and aaaay procaaaing 
emergee in the quantitative enelyeee* Serial petition «ee e 
predictor of reading tieiee for the w el 1 - f orieed etoriee* but it 
does not emerge ae a predictor for the eseftye. We «e*ueie that 
seiial position ia * proay for predictive procaaaing. Whan 
subjects adopt a predictive node they read nor e a Ion 1 y at t he 



beginning ot e text *e they generate hypotheeee* end ami bjuh fc^y 
letei in the teitt bee eve e they ere confirming earlier 
predlctione. Ae we ergued eerller* the TOL dete provide evirlenr* 
thet eubjecte edopt thie etretegy when reeding etoriee but not 
■hen reeding eeeeye. The pretence of e aerial petition eff+rr in 
the reeding Matte for etoriee but not for eeeeye provide 
additional evidence tor thie etretegy difference between etoriee 
and eeeeye* 

Queatlon-aifclnq tgfc tfci tigfelt iJLPJiAl 

One of tht focueeed TOL teefce we heve ueed ia one in which 
eubjecte eek ftjiteetlone following eech eentence* We deecribed the 
eeeence of thie tee* earlier, in thie eection »e preeent eowe 
data thet ehow that the nuetber of Ojueetlone eefced for eech 
mentence corrtletee with eentenca-by-eenteoce reeding tl*>ee> 

Why uea e ojiteetion-eefclng ttefcT We felt it tapped behevior 
relevant to whet ekllled reedtre do while reeding. It eeeped 
pleuelble to ee autre thet eech eentence encountered In e teat 
releee certain ojiteetlone In e reader 'a plnd end enaware other 
qiteetione reieed by earlier eentencee* We wanted to explore thie 
euppoeitlon In itort detail by collecting rich dete on the * Inde 
of giteetlone reedtre eek following tech eentence in eipple 
etoriee ^ 

Thie etudy ueed four teefce. The primary tee* wee one in 
which reedere eeked gue-etlone efter reading eech eentence In the 
etory. In another teek a different group of eubjecte reed the 
eee* etoiiee aUantly while we titled their reading, Theee tape 
eubjecta leter recalled the etoriee. rinelly* another group of 



subjects rated the importance of the constituents of the story* 
Four simple short stories (maximum length was 41 sentence*) were 
used 09 texts* They were All children's stories or simple 
folktales* and all were well-formed. 

To bitter understand ths results* s somewhat more detailed 
description of the four tsSM Is necesssry; 

1, Question-salting* Alt four stories were presented to 9 
subjects* Each sentence in the Story wss typed on a card* and 
the subject worked his or her vsy through the dec* of cards* 
asking questions thst *sre raised in his or her mind as * result 
of having read that particular sentence* Ths subject was told to 
imagine that the story's author was present* snd thst the suthor 
was willing to answer sny qusstions the resdsr had sbout the 
story at that point* except for ths obvious question ot what 
happens next. The subject *bb sllrwed to spend as much time on 
any sentence as he or She desirad* but asked not to reread 

any previous sentences or to look ehes*1* Ths qusstions wsre tape 
recorded and later trsnacribed* The number of questions ssfced 
for each sentence was tallied snd pooled ovat subjects* In 
addition* the qusstions were classified in various ways. 

2* Bead ing times* Sen tence-by-ssntence resding times 
were collected from 20 subjects. At ths end of each story 
subjects wrote a brief O to 5 sentences) summary of ths story* 

3* Recall* Ths same 20 subjects were asfcsd to recall the 
stories they had Just read. They were presented with a brief 
descriptive title for each story* and tiers given unlimited time 
to try to recall as much as they could. They were asked to 
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recall exact words* but were encouraged to guess if they could 
not remember enact words. Recall was scored by first doing' a 
propobi t lonsl analysis of each story and then matching the 
subject's recall against this* using a gist criterion. 

4, Impor tance . Seventeen subjects read each story and 
crossed out the 501 ol the words* phrases* or sentences In the 
story they felt H *s lesst important. For each sentence In each 
story the proportion of t words leEt in sveraged over subjects 
provided s measure of the relative importance ol that sentence. 

It t* useful to hsve a better picture oE what the question^ 
asking date look like. Tsble 11 shows typical questions for the 
first sentence of one of the stories. These questions are 
grouped into those ssfced by two or more subjects and those that 
are idiosyncratic to ona subject. Of course* we were also* 
interested in the sen tence-byten tence variation In the questions 
asked* Figure ) shows the total number of questions es>ed for 
esch sentence in esch oE the four stories, with the possible 
exception of EKERALD, there is noteworthy variation in the number 
of questions asfced from sentencs to sentence* In tM&RALDr there 
were a large number of questions at the beginning and then s 
fairly flat distribution oE questions thereafter. Keep this 
difference in mind, bscause fctifcRALD will not follow the pattern 
of other stories income of our later analyses* 

Insert Tsble 11 and Figure ) ajwut here 

The first Issue we addressed ws^whethsr the quest ion-asking 
task is related to the reading times. He examined this by 
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booking at the relationship between the total number of questions 

r 

asked tor asch stntence in a story end the average reading time 
tor each sentence tor those t .sub Jec ts who were reading silently. 
The expectation wee thst santsncss which elicited s lot of 
questions would be especially ssltsnt to real-tine processing. 
*pd therefore would be rtid sort slowly by subjects who were 
resding silently. This hypotheses was confirmed. We conducted s 
multipls regressions in which the average rssdtng tin* per 
sentence «ss the dependent varlabla-.and several different 

predictor variables vers eiplored. The predictor variables vers 

4 

sentence length, total number of questions* serlsl position, and 
importance. Only ssntence length and nusiber of questions emerged 
ss signiflcsnt predictors of reading tine. In this snslysis all 
four stories vers entered* with story as s variable. There sre 
two types ot questions that occur! those that are asked by 
seversl subjects* and those that fjre Idloeyncrat ic*!" He nest 
asked whether these two types of qusstlons contributed 
differentially to this outcome. Ths answer Is no. A Multiple 
regression with number' of questions asked by two or store persons 
and Idiosyncratic questions sntersd aeparatsly showed that both 
emerged as significant predictors. Table t2 shows the, details ot 
these analyses. 

insert Table 12 about hers 

So, nusiber ot questions asked accounts for a significant 
portion of the variance In sentence-by-sentence reading times. 
We nest asked what relationship the question-asking task has with 
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recall* And the answer was very simple! none. Table t3 shows 
the outcome of a multiple regression carried out on recall 
scores, and reveals that rated importance and serial position* 
emerged as significant predictors ot recall* while number ot 
quest ions asked did not. This leads us to cone lude r that the 
Information being revealed by the question-asking task Is more 
closely associated with tt)e activities that occur during 
comprehension than with the form ot the tlnal memory 
representation constructed as a result of comprehenalon. 



Insert Table *3 about here 



This basic result confirms our initial supposition thst the 
question-asking tssk would tsp an aspect ot what is going on In 
the skilled reader' a mind while reading. The obvious question', 
of course* Is what is It tapping? It is unlikely thst s reader 
who' Is reeding. silently Is actually aaklng questions while 
reading. Rather, w* believe that the tjueetion-aeklng- taak tags 
the kinds ot Informational, needs f reader encounters while 
proceeding through s test. As each sentence is understood and 
added to a growing representation ot the atory; the reader 
revises and elaborates the set of information atlll needed to 
have the developing atory make aense. Thee* informational needs 
interact with whet la preaented in the neit aentence to generate 
a new set of informational needs— or* If you will, a new set of 
questions — that guide the reader's comprehension through the 
succeeding parts of the teit. 

we have conducted e number ot othsr analyses ot these dsta 
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that art discussed in Olson, Duffy. Eston, Vincent, and Mac it (In 
preparation), u* have categorized the question! to see If 
certain types are wore Importsnt thin others. So fsrr the 
cstegorles we have essmlned have not shown eny differences. w * 
heve looted to see whether or not questions eefceo* ere leter 
anevered by the story* snd thers ere Interesting relet ionshlpa 
hers. Many questions art In fsct answered, though It'verlee 
somewhst by type. However, the number of questions snewered by a 
partlculsr ssntence doss not predict resdlng time or recell* **i 
have looked st the Information tipped In ths question* snd find 
thst questions which ere derived frost nsw Information contslned 
In the current sentence sre eepeclelly Import tm nt In predicting 
resdlng times. Thsse snd othsr detslls of thess date are 
interesting snd Important* end will be reported en full^ In oleon 
et at. fin preparation)* 

The Main findings of thle study strongly suggest that the 
questloft-asitlng task Is e useful Indicator of processes which may 
be an Importsnt part of compr ehsnslon* The number of questions 
■shed by subjecte as they reed through • Story correlates with 
the esiount of time spent on thet sentence by other reader* 
reedlnq silently. Keep In mind tha*t this result Is with ths 
obvious effect of sentence length removed. But number of 
questions does not correlate with recall* Thus* questlon-ssltlng 
seesis tiore closely releted to the real-time processes that occur 
during reading than to the final product of comprshenslon that 
remains vheq reading Is completed. 

Thle study is a nice essmple of the anslytlc usefulness of 
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the focussed TOL tssfc. Ho clalsi is made that the question^esiting 
task taps al 1 or even many relevant aspects of comprehension. 
Rather, one paTtlcular~Ttnr*NLtlcelly promising component of * 
cpmprehenelon processing Is singled out for detailed treatment. 
A* with the genersl TOL tssfc* the anslysis of these data can 
proceed in both s quslltstlve and s quantitative feshlon. 

4. RELATED APPLICATIONS Or TOL 
In thle chepter we have focussed on the use of TOL to reveal 
'Comprehension processes. TOL techniques are ussful In some 

closely rslstsd domains, snd In this section we present a few 

i 

essmplss. Each of these usss TOL during comprehension either In 
a speclsl environment or for e epeclal purpose, 
Computer Test Editing 

The TOL method has been ussd to Investigate how nsw 
(computer naive) users lesrn test-processing procedures with 
self-study lnstructlonsl mater Is Is (see Lewis t Mac*, 1982a, 
19§2b, 1982ct Hacfc* Lewis t Csrroll, 1982), in thle situation, 
the Instructions wsre very gene'relt new usera wsre astsd to tsU 
about any sspect of their learning eeperlence. Including their ^ 
Interectlon^wlth the computer Interface snd th* manual. They 
were eated to talfc about any problems or questions they had. end r 
any plene or declalons they might be awere of. Gscept for 
occaelonel non-dlractiwe prompts for reticent telfcere users 
decided when to til it and whst to say. TOL dsts were augmented by 
a wldeo-tsped record of the subject vorfclng st the computer 
terminal. 

The TOL data rewealed much qualitative information about the 
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learning strategies and problems of ne« users. For esample* 
seiE-study Instructions were surprisingly "frsglle* in that it 
was relatively easy for users to get side* t recked trying to 
follow then. This «as due not only to simple oversights but slso 
misunderstandings thst reveal interesting reasoning strategies 
(see. Levis I Hack. 1g82cl also Carroll t Me-ck, (9B2a» tg&2bl , 
The ne« user's "innocence" sbout computers and their complexity 
mede it surprisingly difficult for them to recover from these 
problems, 

tn this application of TOL Levis *t si, have not tried to 
relate qualitative observations to othsr more quantitative 
measures of Immediate processing* although nothing would prevent^ 
doing so in principle. ft Thc qualitstlve dsts alone* however* have 
provided grsst insight ^to the problems of new users in s 
comple* task domain. They have suggested a number of directions 
for more analytical inveetlgetlon of learning* as veil 49 
practical applications in the design of interfaces ana training 
methods. As such* it haa already demonstrated the uaefulneaa oE 
TOL in reaearch on an important genre of taitt tne t rue t lonal 
materiala In their reml-world context c f use. 
TOL as feedback to Writers • 

Recently* «t have begun reaearch that explores the 
usefulness oE TOL data as feedback to writer*. The rationale is 
quite simple. One of the difficulties that moderately skilled 
writers have is correctly decerning the state of mind of the 
reader* They* as writer* have th* complete Structure oE their 
to-be-communlcated ideas in mind. But it is diEficult to imagine 
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the state 1 of *ind of the reader* who does not know these ideas 

> 

t and who may have a somewhat different general state of knowledge 
than the writer, 

We discovered, somewhat accidentally, that TOL data provided 
marvelous feedback to a writer* We had prepared materials Eor 
various test comprehension eiper iment s, and in some of our early 
pilot work on the TOL task «e gave these tests to TOL subjects. 
The information we received from theae subjects about what parts 
of our texts were herd to understand* which parte mlscommunicaled 
what we intended, and which parte violated the conventions o£ 
writer-reader communicst ion was incredibly valuable. This led us 
to develop and use the selected TOL task in the preparation oE 
stimulus materials. In addition, it suggested to us/that TOL 
behavior might in general be a useful Eorm of Eeedbacfc to 
writers. 

He are currently conducting research that directffy eiamines 
this. Writers generate tests of various types from content «e 
provide them* #*nd then a series of readera provide process 
Eeedback t^bput the tentence-bysentence comprehension oE these 
tests either by thinking out loud or by combining talking with 
doing in the case of tests that give instructions for ho* to do 
Something. The writers are given a chance to revise their texts 
in light oE the process feedback they receive Erom readers. 
Though «e have just begun this work* our initial impressions are 
that this' Is an effective Eorm of feedback to the writer, 

He as, investigators as well as the writers of testual 
materials can use TOL data as a messuring instrument Eor the 
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effectiveness of various teits, Endsed* since the effectiveness 
of particulsr tests is e joint function of test properties end 
r eider properties! es ftintsch end hie co-workers (Mntsch * 
VI pond, 1978; ftintsch * van Dije> 1978) hive 10 iptlj 
demonstrsted* studies uiing TOL tulti that verted both test 
properties end reeder chine tar 1 ■ t Ice promise *o provide 
especislly informative data for developing theories of readers* 
writers, end retttuel transmission* 
TOL end Heteco^nitive Awsreness 

Few people engage in TOL activities spontsneousl j, Doea 
esking subjects to thine out loud cause then to chenge their 
processing? The laaue ot whether or not such effects esiet Is 
central to the uee ot TOL Methods <see Ericsson end Simon* 1980). 
Though such feedback etfecte froai TOL ere e metmodologicsl 
problem tor the investigstor Interested in ordinary processing* 
they ere a porentisl boon tor the instructor who would Ilk* to 
Improve the cognitive processing ot s target populstlon. 
Scsrdsmalie snd Bereiter (In press T have diacuased thla feature 
£>t TOL tor children. There haa been stuch reeeerch on the 
relatlonehip between metacognitive Bwsreness sod comprehension 
with grade school children (see Brownr ftranatordr Ferrera, I 
Campione* in press). Scardemalia end BereUer heve found 
intormaHy that TOL mathode often lncreaee the metacogni 1 1 ve 
awarenaaa ot children* Though they heve not jet conducted eny 
formal studies of this relationship* their extensive experience 
with TOL methods suggests to then that it stay be a significant 
instructional device tor reading and writing with children. 



5, WHY DO TOL IWTA PRODUCE VARYING RESULTS? 
In our discussions with colleagues about our TOL research we 
have heard of eeverel disappointing efforts to use TOL to study 
comprehenefon* In [set, in our o«n work, our results for the 
essay TOL teafc were somewhat disappointing. We reported earlier 
the substantial differences in both the richness of the TOL 

protocols and in the .nature ot their correlational relationship 

♦ 

with sentence-by-sentence reading rimee tor simple stories and 
essays. These stilted results are acarcelj surprising. Any 
empirical Technique will have successful and unsuccessful 
spplicatlone. when will TOL be useful? fn considering some of 
the reports of disappointing outcomes and our own successful 
applicstione ot the techniques* we heve cone up with seversl 
factors that csn effect how useful the TOL technique will be. 

Types &t Instructions . We stressed earlier in thie ctopter 
the Importance of being clear end explicit to subjects. The 
sntecedent to this* of course* is understanding precisely what it 
ia that one wanta to get 'out of the task. Different instrucriona 
will produce quite different outcomes. 

It is slso important to make aura the instructions are 
appropriate to the tests beinQ^tftfed, We have speculated that our 
esBaj, TOL dsts were disappointing in part because of the 
Instructions we gave subjects* Recall that our instructions for 
the essay TOL task were elsioat identical to those for stories. 
We used similar instructions so, we could compare results *ecroaa 
genres. The instructions* however* night have been inappropriate 
for essays. For e*ample» we asked subjecta to make predictions* 



130' 



y*t the protocols revealad that making rich contant predictions 
vas an inappropriate tee* 'or reading essays, A more appropriate 
rath «tight have been to ask eutjecta to evaluate how convincing 
art argument was. In fact aoma subjecta spontaneously adopted a 
mora critical made of talking about the argument St 1 ve essaya* in 
these protocols tftv talking ssspisd swrs natural. 

Subjects . Even wl t h" clear instructional not all subjects 
fill talk aqually informatively. We have found that some of the 
bear subject a In our raiaarch heva baan faculty and graduate 
student* In psychology, who have at laaat a paieing acquaintance 
vith TOL mathode end therefora know tha level of Information we 
ara aaaklng. Some subjects do not know thie. avan vith ettpliclt 
inat ruct ione * where larga pools of appropriate aubjacti art not 
available* training subjecta to talk stay be a vey of aniurtng 
ressoneble quality data* The saact content of what aubjacta aay 
haa to be up to them, of course* But the amount end leval ot 

r 

talking can be Inappropr ieta and may be aubjact to training* 

Ve have also found that larga individual dllferancee esiet 
In how aubjecta rasd awe testa* This eesme aapeclally trua tor 
the essay TOL task* Soma aubjacta adopt ad a critical mods in 
reading tha argumentative essays. , Other aubjecti did not* Some 
subjects talked easily about aspects of essay structure te*g f * 
topic sentences, conclusions, pro and con srguments)* Others did 
not. U« assume thess dltferencee in talking rstlect differences 
in strategies readers adopt when reading easaya or differences in 
the knowledge readers have about the genre* While these 
individual differences might be interesting in themselves, they 



made it difficult to find common patterns in the TOL data for tha 
essays. This heterogeneity waa not ao apparent In the atory 
protocols where aubjecta seemed to have a common approach and 
fcnovladge base to use in reading the stories. 

Type of material . One major problem for the researcher \p, 
teat comprehanslon is to find or Construct appropriate teste. , 
Too often Investigators in this area have uaed "stories" that are 
not really storisa or peregrapha that are ao artificial they do 
not reaembla naturally occurring paragraphs, our impression is 
thet the richest protocols are elicited by tents that are natural 
and intereeting* Our two veil-formed stories vere raal r 
children's storiea* Tha plots were engaging enough to mot i vats 
the readar to read on to find out what happens > Tha TOL 
protocols v * r e correspond! ngly rich* In contrast* the essays ve 
used were, frankly, rather bland end\£pring. Subjects had no 
intrinsic reason to vent to keep reading. The resulting TOL 
protocols vera alao rathar boring. While the differences in our 
essay end story protocols may be in pert due to genre 
diffsrencei* we do not bslleve thst is the whols Story* Ve 
suspect thst esssys with store controversial or Interesting ' 
content might have elicited richer TOL data* 

Vher) TOL data are used in the contsat of diacovery. it ia 
especially useful to include a variety ot teat types In the set 
of stimuli* our strstegf of using veil-formed and ill-formed 
texts, or of comparing different versions of teats, te *g* , ^the 
essays) is a useful vay of validating* the quality of the data 
being obtained. It the TOL data are the same for well-formed and 
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Ml formed ****** tUw Inveetlgetor should be susplrioos ut yhet 
tht subjecte in doing. 

Whit l_e enel y gej . There in winy different vaye to analyse 
data •* rich as thoee obtained fro* TOL teeke. Whether One gets 
ueeful Information or not will depend upon whet one looks for. 
Tor inetence* our ssssy TOt dete yisldsd some genere 1 * ueeful 
information ebout the overell strategies ueed In reeding the 
essays. But the multiple regreeelone eeplorlng the tlee between 
TOL behevior ejid reeding times for eeeeye did not yield much. Me 
are currently cerrylng out * number of other more deteiled 
analysis of our TOt dete. For Inetence* «e ere In the mldet of a 
deteiled content anelyele of our original et,ory TOt protocoled 
coding the cheine of hypothesis end other Interconnect lone in the 
date ae e possibir clue to further sspects of the reeding 
strategies of subjecte. Similarly* «* hsve conducted a number of 
other analyeee of our qusst lon-sSk Ing dete that elSo get et 
further aspects of the representation of comprehension proceeeee 
In reading (Olson et sK* in preparation). Not «H enelyeee *e 
have attempted have penned out. It will require breeder 
experience with the uee of TOL date to Study comprehension before 
we will have a clearer picture of the types of enelyaeS^.thet are 
generally more useful. 

6. SUMMARY MID CONCLUSIONS 
Me have used th* TOL tee* ee one vlndov Into the reeder's 
mind. In this chapter we have deecribed various versions of the 
tasks, discussed the overall rationale for the technique and 
discussed Its application to various domains. Me will now 



eummerUe by preeentlng in conclee form e Uet of edvantegee *i»;l 
e list °' llmltetlone In uelng the TOL tesk to etCdy the procf«n 
of comprehenelon. 
Advent eg it 

*• The primary goal In uelng the TOL taek le to eipllcetc 
the higher level proceeeee Involved In compreheneton. When used 
appropriately, it indeed stems to do this. In tect* It aiey b+ 
one of the fen techniques eve I lfbte— to.r. get t Ing et thle level r >t 
comprehenelon activity. 

2- TOL behevlor, under et laeet eon* situations, eppeera to 
correlate with other forme of reading behevlor* such ee sentemr 
by-eentence reading timee. 

J. Though «e heve not done thle yet in our reeearch* TOL 
date In general have proven to be e ueeful meene for studying 
Individual differences In higher level cognitive proceeeee ie.g., 
Nevell % Simon, ig?2>. Studies of readere of varying levels of 
•kill or varying degreee of background knowledge could profitably 
be pureued with thia method, though there might be eome 
difficulty in a confounding between level of reeding skill ana 
ability as s TOL eubject (see belo«>. 
Limitations 

1. The TOL teek le Sensitive to instructional variablee. 
The Instructions must be precfee and must be carefully thought 
out I" relation to one's reeearch goals, vague or very general 
instructions in generel do not work well, further* in light of 
Rr lesson and Simon's f 1 980 > analysis* it is important that the 
task focus on the reporting of current states of knovledge aod 
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not ask subjects to teport on states of knowledge very far in the 
past or to offer explanations for their behavior. 

2. The TOL teak seeme to work better for to** tent types 
than for others. In our ,reeeeech* we fait wa obtained euch 
better TOL data tor etorlee than for eeeayf. However * so far the 
task ha a not been uaad for a very wida range of tent typee. 
Further* aa we suggsstsd earlier* there ara undoubtedly important 
interactione bctwaen taut type and Instruction that are not very 
-ell documented yet . 

3, TOL data are difficult to analyze. Any form of data 
collection which monitore a continuoua fttreem of behevioe ovee 
long intervala of time produce a data which can be difficult to 
analyze* The transcript Ion* coding* and analyaia of TOL 
peotocola ia extremely t ime-coneumlng * and little of it can ba 
automated. Thus* the daclalon to uaa tha TOL taak muat be 
thoughtful and muat taka Into account coet~benefit rstios., 

4* There appear to be big diffarencaa among serojscts In 
their ability Provide .Informative TOL data* Sdpe eubjecte are 
good talkers* some are not. Tha difficulty 1ft One of getting 
talking at en appropriate level end If* appropriate quantity to ba 
useful to the investigator* Thie problem cen be ft*it by training 
subjects to talkr but that le time-consuming* There ere probaoiy 
limits In hov young or hov Intelligent TOL Subjects can be. 

5. The TOL task may influence the nature of the 
comprehension processes used by Subjects.* Ths fsct that ve get 
correlations betveen properties of TOL data and silent reading 
times suggests that similar things may be going on In the two 
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situations. But having subjects think out loud certainly has the 
possibility foe distorting theie processing, and it is essential 
that TOL data always be used along with other converging evidence 
in order to determine what it is thst readers are doing ss they 
work their way through a test. 
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Table 2 

Staple Thinfcing-Out-Loud Protocol of a Subject reading tjgfljt.il 



£N THfc TOWN Of Al^TO, OHIO, THERE LIVED A BQT NAMED LEKTtL. 



In Alto, Ohio, is sort of 
Something about music - . 



. i 1 assume this is going to be a story . . . 

or vegetables because »e have the boy named Lentil. 



LEHTlL HAD A HAPPT LITE EXCEPT TOR OHE THING. 

Host of" t,his story is going to be developed around this one exception. 
H*t.ls generally happy, except tor this one thing. 

HE WANTED TO SING " BUT HE COULD HOT. 

Ah hah. I'm remembering *Alto« Ohio*, that it 1* going to be about 
music, and he wanted to sing la the one thing that was unhappy in his 
lite. The *t of t it going to be about how he learns to sing. Ke is 
either going to go out and find birds and learn from the*, or he is 
going to have a trumpet like the trumpeter swan. The story is going 
to be about fixing the fact that he can't sing. 

IT WAS HOST EMBARRASSING, BECAUSE WHEtf HE OPENED HIS MOUTH TC j?RY, OH LT 
STRANGE SOUNDS CAME OUT. 



1 don* t see what 
sing (repeats) . 

can't a * . 



. it's still talking about the fact that he can't 
no, we are just 'elaborating sr. the lace chat he 



AHD HE COULD WOT EV£H WHISTLE BECAUSE HE COULDH'T PUCKER HIS LIPS. 

More elaboration about hia unhappiness ... he can't produce music at 
all . . , *He couldn't even whistle.* How I'm beginning to think about 
hew we are going to resolve this. Is it going to have anything to do 
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with the fact that hi* name is Lentil? or vegetable*? Is he going to 
do anything with vegetables? 

fc. ' BUT HE OIO MNT TO MAKE MUSIC, SO HE SAVED UP ENOUGH PENNIES TO BUY A 
HARMONICA. 

That seems reasonable. Ha ie going to try different way* to make 
mueic. Ha wants to mueic, not juet eing. 

7. r LENTIL MAS PROUD OP HI$ HEM HARMONICA, AND HE OECIOEO TO BECOME AN 
' EXPERT. , 

So now he*e going to Leern it from eomebody elee. 

0. SO HE Pt#A TED A LOT, WHENEVER ANO WHEREVER. HE COULD. 

Now I tmpect this to be genereting a Lot of ennoyence froet hie 
mother . . . having nolty children* (Repaate) 

9. HIS FAVORITE PLACE TO PRACTICE MAS IH THE BATHTUB # BECAUSE THERE THE TONE 
MAS IMPROVED ONE HUNDRED PERCENT. 

Like singing in the •hover, (repaate) HOw we are going to have 
. developments about him turning into a prune or eomathing . . . 
a prune eitin. (repaate) 

10. HE USED TO PLAT ALMOST ALL THE WAT TO SCHOOL. 

Now thmt's a place not in the bathtub. Ha "used to play" mesne 
he doesn't enymore. Heybe the children made ton of him, or 
eomathing like that. 

U. OOWN VINE STREET TO THE CORNER OP MAIN* PAST THE ft NEST HOUSE IN ALTO, 
WHICH BELONGED TO THE GREAT COLONEL CARTER. 

Thi* isn't even a eentence. He ie playing elmost all the way to 
school. Thie ie the route. Colonel Carter ie juet been introduced, 
and he ie going to develop eomathing with thie little Lentil boy. 



"Used to play almost ell the way to school*" We haven't done anything 
with the bathtub, it might be . . . thie Bounds like a children's 
story. So chat's really reading about children making noise in 
the bathtub. Children love the sound of their own voices. Tall 
in parking structures and tunnels and Stuff like thet. That 
mey develop, may not. 

12. THEN PAST THE DRUG STORE. THE BARBER SHOP. AND THE ALTO LIBRART, 
WHICH WAS A GIPTOP THE GREAT COLONEL CARTER, BT THE METHOD I ST 
CHURCH. THROUGH ™E CARTER MEMORIAL PARK , AND AROUND THE SOLDIERS 
AHD SAILORS MONUMENT THAT THE COLONEL HAD BUILT THERE. 

So now ,nt know Colonel Carter is rich . * . not only famous, but 
rich. "Then by the methodise church" . . . well, you could 
interpret this - • . figure that the Alto library is a gift of the 
greet Colonel Carter. Me are describing more of his wealth. 
"He goes by the methodiet church, through the memorial pari$". 
More of Carter's stuff . . . very famous) . . . and "around the 
Soldier's and sailor's monuments, which the Colonel had built there" 
* . . sort of a central figure now. He is going to develop in 
som* teehion. 

1J. THEH LENTIL WOULD STUFP HIS HARMONICA INTO HIS POCKET AHD TAKE A 
SHORT CUT UP THE ALLET BEHIND THE HARDWARE STORE SO HE WOULD NOT 
BE LATE FOR SCHOOL, 

why would he . . , apparently sll this stuff — playing — slows 

bin down ana he has to hurry up to get to school. "So he stuffs 

it in his pocket and takes a Short cut up the alley behind the hardware 

store, so he wouldn't be late for school." 

14. PEOPLE WOULD SMILE AND MAVE HELLO TO LENTIL AS HE WALK CO DOWN THE 
STREET, BECAUSE EVERYONE IN ALTO LIKED LENTIL'S MUSIC — THAT IS, 
EVERYONE BUT OLD SHEEP, 

I'll bet you Old Sneep is Colonel Carter, That's got to be his 
nickname. He's going to be ♦ ♦ . he is going to put an *nO to 
Lentil'e playing. This is the story of a little boy against 
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the giant . . * David and Goliath* He is 90109 to win over Old 
Sneep in the end, 

is. c!ld sheep did hot like much or AHYTHIHG or aht body * 

Yep, we ar* developing Old Sneep, which I'm 9110591119 is 
Colonel Carter , 

16, HE JUST SAT OH A PARK BENCH AHD WHITTLED AHD GRUMBLED, 

wall, maybe It may not be. Can't imagine an old wealthy 
person aitting on a par'k bench, whittling and grumbling. 
But it could be all the same person, 

17, OHE DAY THE HEWS GOT AROUHD THAT THE GREAT COLOHBL CARTER, WHO HAD 
BE EH AWAY fOR TWO YEARS* WAS COMING HOME, 

well* now'l'm decidin9 that Old Sneep is not the great Colonel 
Carter, So we have Old Sneep, little Lentil who ia playing 
all the way to school, through, acroaa, in front of Colonel 
Carter'a house* and Colonel Carter* who ia great, rich* 
and magnificent and all that. Haven't decided whether 
Colonel Carter is a good guy or a bad guy, 

16. PEOPLE BEG AH TO PLAN A GRAHD WELCOME, 

That's a welcome home for Colonel Carter. Oh, maybe we're 
going to have a parade and Lentil gets to be first in the 
» parade or something like that. 

ig, BUT WHEN OLD SHEEP HEARD THE HEWS HE SAtD, "HUMPH. WE WUZ BOYS 

TOGETHER. HE AIH 1 T A MlTB BETTER 1 H YOU OR MB AND HE HEEDS TAKIH* 
DOWH A PEG OR TWO, " 

All right, now 1 know that Old Sneep is not Colonel Carter. 
Maybe not , , . maybe . , , maybe not , . . probably not, so we 
have a humbug here* who is unhappy. So he ia going to try to destroy 
the parade, or whatever we're going to do the grand welcome# 
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Table 3 

j 

The Hell-formed Story Lent i 1 



1. in the town of Alto, Ohio. tjt£re lived a boy named Lentil, 

2. Lentil had a happy life except Cor one thing* 

3. He wanted to sing - but he couldn't, 

4. It was most embarrassing* because when he opened his mouth to try, 
only strange sounds case out, 

5. And he couldn't even whistle because he couldn't pucker his lips, 

6. But he did want to make music, so he s^ved up enough pennies to buy a 
harmonica, 

7. Lentil, was proud of his new harmonica, and he decided to become an 
expert, 

8. So he played a lot, whenever and wherever he could. 

9. His favorite place to practice was in the bathtub, because there the 
tone was Improved one hundred percent. 

10. He used to play almost all the vay to school. 

IK Down vine Street to the corner of Main, past the finest house in Alto, 
which belonged to the great Colonel Carter, 

12. Then past the drugstore, the barber shop, end the Alto Library, which 
was a gift of the great Colonel Carter, by the Methodist Church, 
through the Carter Memorial Parte, and around the Soldiers and Sailors 
Monument that the Colonel had built there* 
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1J. Then Lentil would stuff his harmonica into his pocket and take j shortcut 
up the alley behind the hardware store so he would not be late Cor school. 

14* People would Mile and wive hello to Lentil as he walked down the street* 
because everyone in Alto liked Lentil's mueic - that is, everybody but 
Old Sneep* >^r 
0 W 

15* Old Sneep didn't like much ot anything or anybody* 

16* He just sat on a park bench and whittled and grumbled* 

17* Cne day the news got around that the great Colonel Carter* who had been 
- awey Cor two years* was coming home, 

18* People began to plan a grand welcome* 

19* But whan Old Sneep heard the news he said, "Humph! We *u* boys 

together - he ain't a mite better'n you Or ft* and ha needs takin* down 
a peg or two** 

20* Sneep just kept right on whittling, but everybody else kept right on 
i planning. 

21* Colonel Carter was the town's most important citizen, so the people 
hung out ftaga end decorated the streets* 

22* The mayor prepared a speech* 

23* The Alto Brass Band put on their new uniforms* 

24* And the printer, the grocer, the plumber, the minister, the barber, the 
druggist, the ice men, the school teachers, the housewives and their 
husbands and their children - yes f the whole town went to the Station 
to welcome Colonel Carter* 

2S* The train pull*) in* 



26* The musicians in the band were waiting Cor the leader to signal them to play, 

27* The leader was waiting tor the mayor to nod to him to start the bend* 

23* And the mayor was waiting Cor Colonel Carter to step from his private 
car * 

29* All the people held their breath and waited* 

30* Then there was a wet sound from above* 

Jl* Slurp! There was Old Sneep* sucking on a lemon. , 

12* Old Sneep knew that when tha musicians looked at him their mouths would 
pucker up so they could not play thair horns* 

33* The whole band looked up at Old Sneep* t 

34* The mayor gave the signal to play* but the cornetist couldn't play his 
cornet, the piccolo player couldn't play his piccolo, the trombone 
player couldn't play his trombone* and the tuba player couldn't play 
his tubai because their lips were all puckered up* 

35* They couldn't play a single note) * * 

36* The musicians just stood there holding their instruments and looking up 
at Sneep sucking on the lemon. 

37. The leader looked helpless* 

30L. The people were too surprised to move or Say a thing. 

3g. And the mayor wrung his hands and wore a look that said; 'Can't some- 
body do something, please?" 

40. As Colonel Carter stepped from his car* the only sound was the noise oC 
Sneep* S legion . 
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41. Clouds begin to gather on the colonel's brow and ha said, "Humphl" in * 
in indignant lort of way. 

42. Of count Ltnttl't tip* vert not pucker ad tnd ht'knew something had to 
be dona. 

43. So ht took out hit harevonict and starttd to pity 'Coffin* 1 Round the 
Mountain When She Cone*." 

44. whtn Ltntil be<Jen to pity tht second chorus. Colonel Carter sailed. 

45. Thtn ht ltt out t loud chuck la tnd began to sing. "... driving ti* white . 
hOrSee vhtn She costet*" 

46. Thtn everybody aeng tnd thty til starched dovr. Kaln Strttt bthind tht 
colonel's car. 

47. Lentil rodt vlth tht colonel, vho took a turn tt fhe harmonica vhtn 
LtntU's etnd began to O/ive Out. 

4d. <Kt said ha hadn't playtd one since ht vtt a boy, but he did vtry 
veil coneidering, > 

4g. They marched to tht colonel's house tnd paraded through t t he gate and 
onto tht front ltvn. ^ 

50. The aayor'e coeaeittee served ica crttn cones to all the 
citizens and Colonel Carter made a spetch saying hov happy 
ht vta to bt hone tgain. 

51. when he said thtt he vat going to build a nev hospital 

for tht tovn of Alto, everybody wee happy *- tvtn Did Sneept 

52. So, you ntvtr can tell vht t vlll happen .when you ltarn to play tht harmonica* 



Ttble 4 

Proportion of Think ing^Out -Loud Productions in Each Category for Stories 



Category 


Lenti 1 


Stranger 


Ghosts 


Circle Island 


Predictions 


.22 


.23 


.13 


.26 


Quest ions 


.04 


.02 


.10 


.01 


Comments on structure 


.09 


.06 


,08 


.10 


Comments on dvn behavior 


.03 


.03 


.04 




Confirmation of predictions 


.02 


.03 . 


.01 


.02 - 


fteferehces to antecedent 

information 


.29 


.36 


.30 


.27 f 


Inferences 


.30 


.24 


.30 


.27 fc 


$ " 

General knovledtje and 
associations 


.02 


.04 


.03 


.06 
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Teble 6 

well-forged Vereipn of Carpeting ,B»eaf 



1. f ehould etert by adeiltting that ee little ee five yeere ego 
cerpeted cleeerooe* vould rightly bave eeeaed too fenclful , 
end eepeneive. 

2. The carpeting then avelleble vould heve been coetly. 
difficult to ftelntain, end would heve required frequent " 
repleceaent . 

3. Nov, hovever, beceuee of improved woterlale the ergu#wnte In 
fevor of eiteneive carpeting eeen e greet deel etore 
plausible. 

I. tiev indoor-outdoor eynthetlce ere eteln reeietent* lede 
reeietant* dureble end ineipenelve. 

S. They heve eiede carpeting eeeek etuch leee e luiury than e 
reeeoneble, e^ven deelreble, elternetlve to tile floore. 

4. Briefly, there eeee>e to be three central argueente in favor 
of carpeting. 

7i Plret| of couree* carpeting it ettractive. 

8. tiov, ed»lttedly* modern technology offere a greaj^ver iety of 
attractively colored tllee. 

9. The deye of dreb, lnetitutionel greye. greene. and brOvne in 
tile ere over . 

10. But vhlle tile *ey epproech cerpetlng in terete of color it 
hae e hard and unattractive teeture. 

II. Carpeting, on the other hand, it oplorful, attractive to the 
touch, and copfortable to walk on.^- 

12. i\ goes a long vay tOvard creating a pleaeent ataoephere ell 
of ue would like to work in, both in end oilj of claee. 

13. Richly colored carpeting, euch ae bold rede often ueed in 
banks and coeawrcial offices, vould aeke our facllitiee leee 
inet itutional . 

14. Bright carpeting can eeeily wske attractive an area that 
vould otherwiee eeeet Spartan arid eterile. '* 

15. In ehort, cerpeting eeeete deeirable eietply because it ie 
»ore ettrectlve to look et and velk on than tile*. 
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T6* The second argument In favor of carpeted classrooms is 
essentially that carpeting serves a useful sroustical 

function. 

Of course* the flexible backing and rough texture of modern 

tiles make them far less noisy than these of just a fev 
years ago. 

tB. Both tiles and carpete have Improved significantly. 

19- Carpeting, however , la a euperlor dempensr of sound. 

20. It cuts noise from crowded hsllways, absorbs annoying 
background noise In classrooms and makes busy space less 
noisy, and therefore more prscticeK 

21. tn industry, if not in echoole , one frequently finds 
csrpeting tn busy sreas bscsuse it reduces noise, 

22. A final argument in favor ot carpeting is that over e period 
of time, carpeting is no mors expensive than' t i le. 

23. Certainly'* carpeting cost more than tile and it does need 
event us 1 teplacament . 

24/ But cerpeting costs much less to maintain than tile* which 
neede frequent washing* waxing end dusting. 

25. The new Synthetic carpets resist stains end fading* 

26. An ordinary vacuum cleaner will keep them in shape. 

2?. But the tils floor, unfortunately, needs frequent scrubbing 
and waxing* i£ it Is not to look dull and yellow with 
accumulated wax* 

2B. This process is iaborioue end slow* and, in large 

institutions, it rsquitss expensive scrubbing machines. 

29. In short, tile costs less than carpeting to installr 

30. But count in the mai nt enance*, and carpeting becomes a 
legitimate economic alternative to tile. 

31\ Were it not fcr the advantages in appearance and acoustics 
of carpeting, one could perhaps argue in favor of 
convent ional tileflooring* 

12. After all, the costs over a very long period, say twenty or 
thirty years, are genuinely unpredictable. 

33. Ue pimply have not accumulated enough experience with the 
new synthetics. 
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34. Perhaps over a quarter of a century carpets will prove more 
expensive . 

35. Perhaps »e will discover that »(J* r * decade or so, the 
savings in maintaining carpets uMi evaporate. 

36. To this point, however, our expetience with the ne» 
synthetic materials is essentially affirmative. 

37. And so, given the clear edge carpeting has over tile 
aesthetically and scoust lea 11 y, snd its economic 
just 1 f icst ion, carpeting seems sensible. 



Tsbls 9 

Comments fro* Thinking-Gut -Loud Subjects Reading 
Lsts-Thests Vsrsion of Ice Age 



Sentence Subject 6 

\ 

4, With thia aentanca ha ia setting up vhat tha subject 
will actually be. And the next sentence vill almost 
certainly be vhat his ••say is actually going to be 
about. 

5. InStaad of telling right out vhat the problem is* the 
person ia delaying it a little bit, and nov you gat a 
sensa of unaasa — vondsring vhat it ia this person 
i r s talking about. 1 vou.'d expect though that the 
subject, tha main subject of this essay vill ba 
coming up very shortly. 

J2. Again thara era wore hints about ice agea here; even 

though tha ica aga — ha haa not really said anything 
about it. 1 nov beliava that tha vhola structure of 
ths essay up to this point hss been to keep the 
rssder uneasy, just dropping littls bits ol 
information until finally he ft avers thafve should 
bs expecting snothsr ice sge even though hs has never 
said so yet. 

13. QK, finally he does say that we're on the verge of 

another ics eg*. 

Subject B 

4, 1 expect* the next sentence to tell us exactly vhat 
this serious problem is. 

5, This is the beginning ol a nev paragraph, and I 
really don't knOv vhat they're going to be talking 
about yet. 1 think that perhaps the serious problem 
that the esssy's going to discuss should have been 
mentioned in the first paragraph or somehov it's 
going to be tied in in the neit couple of sentences. 

6, That's fine, .but vhat does it have to do vith a 
serious problem? 

7, It looks like they're giving u£ all the symptoms of a 
serious problem, but ve don't really knov vhat it is, 

0. Wonderful, ve still don't knov why ve'te discussing 

this. 



9. Somehow I feel 1 missed the vhole sentence tying this 

togetber. We still haven't been told exactly, vhat 
the essay's going to be about* the main theme, All 
that's been done is examples after examples. 

tO, All these examples sre fine, Hovever we're halfway 

done with the e&ssy and ve still don't. knov vhat 
i ve'ra talking about. 

13. Thia sounds liks the theme ol our essay, nov that 

ve're halfvay through. ] think tha introduction was 
rather long. 

Subject 9 

t. 1 expect him now to give me vhat this more serious 

problem is. 

11, It hss taken me 11 aentancaa to figure out .where this 

assay is going to go. It doesn't rsally seem that 
those 11 sentences hsve done a good job of telling ne 
vhat the point of ths sssay is going to be. 

13. This sentsnce could have Started the entire essay, 



Motet Sentence 4 states: *8ut mankind may soon be facing a more 
ssrlous problsm than any of these, 4 
Sentence 13 is the thesis statement t *lt nov seems 
probable, cl imatologist* eayv thst the vorld is on the 
verge of another ice sge.* 
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Significant Predictors ot Siutence-b^Ssnttnce Raiding Times toe Srtftple stories 





Ltntil 


— t 

Strinair 


Ghosts 


CircU Island 


Anilyiis with 

SsrUl Position 


Syll, ,&6 

e*p pn« . f 4ft 

lot. ,/™9 


J* 

Syll. ,493 
Sir • Pos • * 588 
Gen.Knov. .659 


Syll. .743 
Gsn • Know • .826 


Syll. .604 


Analysis without 
SsrUl Position 


Syll. .696 
Inf. .741 
Prtd. .762 


Syll. .493 
l*p. .540 
Prtd, .603 
Gin.Kno*. ,666 


Syl». .743 
Gtn.Knov. .826 


Syll. .604 



Hoti: Syll.*nuab*r of sylliblis, Sir.Pos.*sirial petition. 
G4n*.Kno*.*g«ner«l fcnovlsdg*, lof.*ouab#r of inferences, Pred,*nu*btr of 
predictions l»p.vritid inportiocs. Tibls sotrlis irs ths cumulative 
viriiACi accounted for by ■ ■tepviee multiple regression, listed to eech 
cell io the order they were selected. 







Table 12 

Multiple Regression Analyses ot Reading Time in Question-Asking Experiment 





Coef ( , 


Sig* 


Cum. R 




Predictors selected: 










^ Sentence length 


130,22 


^ ,0001 


.589 




Total number of questions asked 


26.44 


.0001 


.640 




Predictors not Selected? 










Serial position of sentence 










Importance 








2. 


predictors selected 




r 






Sentence length 


130.81 


.0001 


.589 




Idiosyncratic questions 


40,27 


.0004 


.626 




number of questions asked by two 
or more subjects 


87.42 


.0015 


.652 




Predictors not selected: 










Serial position of sentence 










Impor tan ce 








Mote: 


Forward stepwise regression, dependent 


vor iable»m 


ean reading time 


per 



sentence, 
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Table 13 

Multiple Etegreiiion Analyaei ot Recall in Que*tion*Aifcing Ciperiaent 





Coe**. 


Si*. 


Com* ft 


Predictor! itlectedr 








laportence 


341.12 


.0001 


.23S 


Serial poiitton ot sentence 




.0024 


.283 


Predictors njt selected: 








Sentence length 








Total nudkber ot queitiom esfced 









Note; Forward itepviie regreiiions, dependent veriable*proportion propositions 
recalled per itntmct. 
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Knowledge Bose 



Working Memory 



Real World Knowledge 
_ • Physical World 

• Social World 
Genre Knowledge 

• Story Schemas 

• Inductive Arguments 

• Compare and Contrast 
Essays t 

Text Knowledge 

• How Texts Are 
Assembled 

Strategies 



Text 




Current Lines of Thought 

• Predicted Content and/ 
; or Structure 

• Unanswered Questions 
or Confusions 

• Criticisms 
Knowledge Space 

• Representation of Text 
Read So Far 

Narrator Space 




June 22, 1983 t Olson, DuHf I Hack 

Question-ashing a« *• Component of Tent Comprehension 
Gary H» Olson 1 
University of Hichigsn 
Susan a, Duffy 
University of Massachusetts 
and 

Robert L» Hack 
IBM Watson Research Center 



DPAFTi DO HOT C1TK WITHOUT PERMISSION 

To appear ini h . Gtsesser I J. Black tEds.l* The psychology of 
questions . Hillsdale, H.J.t Laurence Erlbaum associates* 



June 22, 1983 2 Olson, Duffy I Mack 

Question-asking a* a Component of Test Comprehension 
Gary H, Olson' 
University of Michigan 
Susan A» Duffy 
University of Massachusetts 
and 

Robert I*. Hack 
IBM Wstson Resesrch Center 

In its primary mx)e of use, ft question is ft devics for 

seeking nsv information that is to be rftlsted to an en* sting 

knowledgs structurs* When to ask s question* and essctly what %q 

ssk* ftrs both symptomatic of the status of ths knovlsdgs 

structurs et issue* ■■ well ss, no doubt* the general 

intelligence of the raker. He have ftll encountered^he person 

v - 

(oftsn ourselves!) who Indicated they did not knov snough about ft 

topic to ssk a question about it. Thus* Intuitively, there is a 

t 

lint between one's knowledge or undsr standing of a topic and the 
sbility to ssk a question about it (e.g.* see Miyske I Hormsn* 
I97g>. 

There is onothsr connection between questions and 
comprehension. Educators and resesrchers hsve long suspected 
that spproaching the comprehension of test vith either genersl or 
specific questions in mind might facilitate understanding. There 
is a sizsble research litersture on this role of questions in 
understanding test (s.g** Anderson * Biddls* 19751 rrsse* 1975). 
Questions of this type focus the reader's attention on esactly 
those pieces of information that are Important to understanding 
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June 22. 19B3 3 ^ Dleon, Duffy t Mac It 

■4 

what the text le ebout* Since one of the problems field. by the 
reader Is selecting the moet relevant or important Information 
fro* ■ tent, appropriate queetlone can serve seta guide &r this ^ 
import in t procen. 

Tlieee two uiei of queitloni in relation to wider itindlng 
have an Important relat lonehlp. Queitloni aeked about a tent are 
both an indication ol having understood that his been read ind a 
guide to the further understanding of what ii about to be read. 
Thli luggeited to ui thit queitloni aeked by ■ reader vhlle 
reading ■ tent might be in especially Informative kind of data 
for monitoring thi reader 1 ! Understanding of the tent. 

tte have carried out a program of research aimed at finding * 
• hat klnde of highir livil cognitive proceeeeft reeders engage in 
while rmdlng limpti texte. We fait one aimple strategy for 
obtaining this kind of Information would be to have readers think 
out loud vhile reeding. We wara motivated by a belief that 
intelligent reading has sfcany aiflnitiea with problem-solving* a 
domain in which thinking-out -loud protocols have provad to be a 
useful research tool. A series of atudlea using this method Have 
revealed a number of Important pHenomene about reading (Olson, j 
Dufly t Hack* I960* 19B31 Olson* Hack » Duffy* 1961). One 
especially important finding haa been that characteristics of the 
thinklng~out-loud protocols correlate with allant reading time 
(aee details In Olson et al.* f 9ft 1 • 19B3), Suggesting that the 
information obtained irom thia method relevant to 
understanding the nature of tent comprehenalon . 

\ 
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June 22, 19B3 4 Dleon* Duffy t Mack 

One of the things ve noticed eubjecte doing while thinking 
out loud during reading waa asking queatlona. The klnda oj^ 
queetlona people aakad and the places they asked them seemed to 
us indicative of^lmportent comprehension rjFoceesee. Thla lad us 
to conduct a apeclflc study on tha relationship between on-line 
question aaklng and comprehension. In thla chapter we aha 11 
raport a few highlights of this study. A more complete report of 
it will appear In Olson. Duffy, Eaton, Vincent and Hick (In 
preperet Ion) . 

Let ue fttnamariae the general rationale for this study* The 
kinds of considerations *e have aketched lad ue to believe that 
questions aeked by eubjecte during the reeding of a staple tent 
would be dlegnoetic of Importent comprehension processes, tt 
seemed pleuelble to assume that eech sentence encountered in a 
tent raises certeln Que at Ion a In e reader 1 Smlnd end answers 
other queetlone releed by earlier sentences. We wen ted to 
explore this supposition In more detail by collecting deta on the 
ktnde of queetlone readere eek following eech sentence in simple 
stories . 

Thie^ study used four tasks. The primary taek waft one in 
which readere aeked queetlone efter reading each sentence In the 
etory. In enother teek a different group of eubjecte reed the 
a erne stories silently while *e timed their reading* Thess ssme 
subjects later recalled the stories, finally* another group ol 
subjects rated the importance of the conetituente of the. etory. 
Pour ehort elmpie etoriee (maximum length wae 41 sentencee) vere 
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June 22, I9B 1 S Olson, Duffy t Hack 

med ss test*. They »fre all children's storiss or simple 
(olhUUi. snd all vere vel 1- formed * 

To better understand the results* * somevhet more detailed 
description of the (our tajiks is necessary) 

t. Question-asking. Ml four stories were pressnted to 9 
subjects. Each ssntence In ths Story vss typed on a csrd, and 
the subject worked his or her way through the deck of cards, 
ashing questions that were raissd in his or her mind a* • rssuit 
of having rsad thst particular sentence* Ths subject vas told to 
Imagine that the story's author vas present* snd thst the author 
va* willing to ansvsr any questions the reader had about the 
story St that point* eicept for the obvious gueation of vhst 
happens neit. The subject was al loved to sp^nd as much tine on 
any stAteoce as he or she desired* but vaa asked not to reread 
any previous sentences or to look ahead* The questions vere tape 
recorded and later transcribed* The number of qusstions asked 
for each sentence^ vas talliad and pooled over aubjects* In 
addition* th* question* vere classified In various vays* 

3* Beading t imea . Sentence-by- aentence reading times 
vere. collected fro* 20 subjects. At the end of each story 
subject* vrote s brief (3 to S'sentences) losaftr? of the story. 

3- Recall* The nae 20 subjects vere asked to recall the 
stories they had just read. They vere presented vith a brief 
descriptive title (or each story* and vere given unlimited tine 
to try to recall as much as they could. They vere asked to 
recall e«act vords* but vere encouraged to guess if they could 
not remember e«act vords. Recall vss scored by first doing a 
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proposit ional snalysis of each story and then matching the 
subject's recall against this* using s gist criterion. 

4. Importancs . Seventeen subjects resd each story and 
crossed out the SOX of the vords* phrases* or sentences in the 
story tbey felt *as least important* for each sentence in each 
Story the proportion of vords left in averaged over subjects 
provided a measure of the relative importance of that sentence. 

It is useful to have a better picture of vhat the question- 
asking dsts look like. Table 1 shovs typicsl questions for the 
first sentsnce of one of the stories. These questions are 
grouped into those ssked by tvo or pore aubjects snd thoss thst 
are -idiosyncratic to on a subject Qf course, ve vere also 
interested in the sent ence-by- sentence variation In the questions 
ssked* Figure 1 shovS the total number of questions asked for 
each sentence in each of the four stories* With the possible 
eiception of EMERALD, there is notevorthy variation in the number 
of questions aakad from aentence to ssntencfc* In EMERALD, there 
vera a large number of questions at the beginning and then s 
fairly flat distribution of question a thereafter. Keep thia 
Jifference in mind, because EMERALD vill not follov the pattern 
of other stories in some of our later analyses* 

Insert Tsble 1 and Figure 1 about here 

The first issue ve addressed vas whether the question-asking 
task is relstsd to the resding times. He eiamined this by 
looking at the relationship between ths total number of qusstions 
asked for each sentence in a story and the average reading time 



162 



June 22, 196* 7 Olson, Duffy t Hacfc 

for each sentence f >r those subjects who were reeding silently. 
The etpectstlon v *« that sentences which elicited s lot of 
questions would be especially salient during rest-time 
processing* and therefore would be read more slowly by subjects 
who were reading silently, This hypothesis wss continued. «e 
conducted Multiple regressions in which ths sversge reeding time 
per sentence was the dependent variable, and the predictor 
vsrisbiee were eentence length* totei number of questions* eeriai 
position, end importsncs. Only eentence length end number of 
questions emerged •• significant predictors of reeding time* In 
this anslysls all four etorlee were entered, with story as e 
variable, There 'are two types of questions thst occur t those 
that art* asked by eeverel subjects, end those thet are 
Idiosyncratic* We next ssfced whether these two typee of 
questions contributed differentially to this outcome* The enewer 
was no, A multiple regression with number of questions ashed by 
two or more persons end Idiosyncratic questions entered 
separately showed thst both emerged as significsnt predlctore* 
Table 2 shows the deteils ol these analyses. 

Insert Teble 2 about here 

when we carried out multiple regression analyses for each 
story Individually, the results mirrored the overall snslysls, ' 
In these regressions «• included as predlctore Idiosyncratic 
questions and questions esfced by two or more persons as well as 
total number dt questions asfced. For three of the four stories, 
st least one of these question counts emerged as s significant 



June 22, 1903 0 Olson, Duffy t Hacfc 

predictor of reading time (in addition to number of syllables}. 
The exception was r HERALD. Cor which the question data provided 
no Significant predictor. As mentioned eeriler* EKERALD was the 
Utory that Showed little variation in number or questions asfced 
across sentences. . 

So, number or questions asfced eccounts tor a significant 
portion of the verience In sentence~by-eentence reading times. 
We next asfced ehat relationship the quest ion-asfcing tssfc has with 
recall. And the answer was very aimplet none* Table 3 shows the 
outcome or s multiple regression carried out on race it scores, 
end reveals that rated Importance and serlei position emerged es 
significsnt predlctore of recall, while number or questions ssfcsd 
did not. This pattern Is similar to other deta «hlch Indicate 
thst importsnce predicts recall (Meyer, 1975* Kintech* 1974). 
Importance is' not necesssrily Immedistely perceived, but may 
result from having most or all of ths final memory representation 
of the test* We conclude from this thst the information being 
revealed by the questlon-aefcing tasfc Is more closely sssocisted 
with the activities that occur during comprehension than with ths 
lorm or the finsl memory representation constructed ss a result 
of comprehension. 

Insert Table 3 about here 

This basic result confirms our Initial supposition that the 
queation-ssfcing tasfc would tap an aspect or whst Is going on in 
the sfcllled reader's mind while reading* The obvious question, 
or course, is what Is It tapping? It is unllfcsly thst a reader 
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who Is reading silently Is sctuslly asking questions while 
reading* Rather* we bellevs thst the ques t lon~ssk ing teak taps 
the kind! of intotmetionsl needs a reader encounters while 
proceeding through e teat > As ssch sentence Is undsrstood snd 
sdded to s growing reprssen ts t Jon of the story* ths reader 
revises and elsboretes the sst of information still needed to 
have the developing story stake sense. These Intormet lonsl needs 
interact with what Is prssented In the neat sentence to generate 
a new aet of Informational needs — or* If you will* a new aet of 
questions — that gulda tha reader' ■ co*Prehanftlon through t*>e 
succseding parta of the text. T 

He have conducted a number of other analyaea of theae data 
that *re discussed In Olson* Duffy* Eaton* Vincent* and Hack H*n 
preparation). He have categorised the queatlona to see If t 
certain typea are mora Important thari othara . So Tar* the 
categoriea we have eaaailned hava not ahown any differences* He 
have also looked to aee whether or n ot queatlona aaked are Jeter 
answered by the story* and thera era Intereatlng rala t ioPahlpa 
here. Kany queatlona are In fact answered* though It varies 
aotiewhat by typ*. Mowaver* the number of quaatlona ensweted by a 
particular sentence doea not predict reading time or recall. He 
have looked at the Information tapped In the question, and find 
that queatlona which are derived from new Information contained 
In the current aentence are especially Important In predicting 
reading times* Theae and other details of theaa data are 
interesting and important* and will be reported on fully Jn oleon 
et si. tin preparation). 
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The main findings ot this St ody - St rongly suggest that the 
queation-aaklng taak la a useful Indicator of processes which may 
be an Important part of comprehension. The number of questions 
astted by Subjects as they read through s story correlates with 
the ■ mount of time spent on that sentence by other readers 
reading allently. Keep in mind that this result Is with the 
obvious effect of sentencs length removed. But number of 
questions does not corrslste with recall. Thus* queat lon-esaing 
seems more closely relsted to the real-time processes that occur 
during raadlng than to the final product of comprehenalon that 
remains whsn resdlng Is completed. 

How general are theae findings? He do not yet know. 
Clearly* we can only confine our conclusions to ths reading of 
Simple atorlea by raaaonabJy aoPhlatlcated resders. Other types 
of Storlss* other types of teats* snd other types of resders 
might yield quite different outcomes* But these Inltisl results 
are promising enough to warrant the estenalon ot this paradigm to 
these other altuatlona. 
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Table I 0 

Sample Quest ion 9 I row The Sell >nq of the Cow 



Questions asked by 2 or store subjects t 


§ Subiects 


1) Who is Crosier? 


2 


2) What Is Crosier like? 


3 


3> Did Croster live alorfe? 


5 


4) When did this story take place? 


5 


5) Where was the tarsi? 


4 


S) where was the hill? 


4 


7) Why vat the tarsi on a hill? 


2 


6) How tar up the hill was the tarn? 


2 


9) How high was the hill? 


3 


10) What kind ot tarn vae it? 


. 4 


11) What will. happen to Crosier? 


2 



ldiQSTrtrratlr Questions asked b£ OnlV % Subject t 

1) Does the fact that he lives on a tsrm have any 
significance? 

2) Does he tarn tor a living? 

3) Does he have another vocation? t 4 

4) Is Cromer married? 

5) Hew old is Crosier? 

6) Hov tar away sere Cromer's nearest neighbors? 

7) Why did Crosier like to live on a. farm? 
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61 Are they going to roll something down the 
hi 117 

9* Did a lot of the dirt vaih ofr the ildi of 

the hill so that Cromer couldn't have hit crops? 

IDF Whit Cro*ir*i first na*e? 

ill Was that Crosier*t tint mate? 

\2) Then whit *ai Croa*r*i list na*eT 

13k Did Cro«tr hivi *>ori than one nine? 

14) Whit hind or name li Crosier? 

» S I What doei Cromer *em? 

16) What nationality ii Croster? 
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- figure Caption* 
figure 1* Total numbed of questions ashed for each sentence In 
four tfl*ple stories* 
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In Sentence Integration 

Susan A. Duffy 
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Annual Subject Indexi 

Co^prf»l»(*f>ciof> 
Teat 

Text 

Processing 
Sentence 

Integration processes. 



Abstract 



In three experiments subjects read a series of narratives that 
varied In the degree to which they elicited an expectation that 
particular oenttneea would be followed up (High Expectation vs. 
Low Expectation texts). Subjects were faster to judge a target 
sentence to be unrelated when It followed a High Expectation text 
than when it followed a Low Expectation text. Subjects were 
slower to read «n_ unimportant* expectation-violating sentence 
embedded in a High Expectation text, Results suggest that 
expectations are used to lntegrste upcoming sentences into the 
text representation. .Correct expectations can help the 
Integration proceast Incorrect expectations interfere, A third 
experiment found no evidence that £hese expectations took the 
form of highly specific predictions. 
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The idea that skilled reader* regularly Corn expectations as 
they read is not a new one. within the reading literature* 
claims have been marie that reading la a "guessing game" In which 
reader* make minimal use of the information on the printed page 
(Gooriman, 19671 llaber* 197BI Smiths 1971). At least two kinds ol 
expectations that a reader might use have been investigated with 
mixed results! expectations about individual words in a sentence 
(e.g.* Ehriich 4 Ftayner* 19Blr ^Eisenberg 4 Becker, 19B2I 
McClelland 4 Q'Reganr I981)r and expectations about upcoming 
syntactic categories (e*g*, rpdor, Bever 4 Garrettr 19741 
Mitchell 4 Green* 1978). The experiments reported here provide 
evidence for the use of expectation* at a higher level of 1 
proccGsingi expectations about upcoming events In a narrative* 
These expectations will be discussed In terms of the role they 
play in causal inTerencing during reading* 

The ixottXtm tlajiE&JL Cohesion 

If the reader's goal is to comprehend the sentences of a v 
text as a coherent whole* the reader must Kind a way to integrate 
eneh successive sentence with the mental representation of the 
sentences already read. To integrate a sentence* the reader must 
find some way of linking the information in the sentence to a 
mihret of the inf or*at ion presented earlier* 

Two kinds of links are important in the current context* 
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The ft, lit are the referential links established between an 
anaphoric |>hrase and its antecedent. The second are links which 
establish what Keenan (Note 1) refers to as causal cones-ion among 
propositions. An example can make this distinction clear* 

la. Johnny had blonde hair, 

lb. He bought a harmonica* 

2a. Johnny wanted to make music* *■ * 

2b. He bought a harmonica. 

In both of theae sentence PMrst a referential link i* 
established between "He" in sentence b and 'Johnny" in sentence 
a. The two sentences in the first pair* however, seem to be 
unrelated fscts about Johnny* In contrast* the second pair are 
causally related In the sense that the want expressed in 2a is 
the "cause" for the action taken in 2b* To fully understand 
these two sentences the reader must establish both the 
referential and the caucrl link. If the reader only establishes 
the' referential link in the second pairr an important aspect of 
the intended weaning will be lost. 

* The discovery of causal cohesion is especially important in 
narratives* when a reader makes sense of a narrative text* a . 
nsjor goal is to build a representation of the causal links among 
events (what Wilensky* note 2 t terms "explanation-driven 
understanding")* The reader wants to be able to explain why 
certain events occurred tin terms of causes and enabling 
conditions) and what happened as a result (consequences)* Thus 
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the reader wight be expected to pay attention to causally 
Important information. This la information which needs 
explanation or which wight provide an explanation for upcoming . 
events In the narrative. Thla claim la given some support by 
rrftparch of cirilo and fosm <19i0) which mhOwed that readers 
spend wore time reading Important sentence* in stories* aentenceo 
which wake up the caueal chain. Important sentences* especially 
ear ly in a story r al bo happen to be sentences which will have 
consequences later on. This meatts these sentences will be 
crucial for establishing cauaal Cohesion later on (when the 
arntrnces conveying the consequences are encountered)'. 

Current models of sentence integration Eocua on the search 
for referential links as the key to the proceaa of relating the 
current (sentence, to what has been read (Clark 4 (laviland* 1 97 7 1 
Clark 4 Sengul* 19791 Carrod 4 Sanford* 19771 Kintsch 4 van Dljk, 
1978f Lesgold* Roth 4 Curtis* 19>9), v et as the above account 
wakes clears the discovery ^f causal Cohesion la also crucial to 
cofnpr rhension. 

One night imagine that eatablishing referential cohesion is 
a mt>loi part of finding causal cohesion. For example* the search 
for antecedents for definite noun phrases in the current sentence 
wight lead directly to the information in the earlier test needed 
to establish cauaal cohesion? In fact* however* causal cohesion 
can exist between sentences with no explicit argument overlap. 
An example can make the problem clear. 
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John was eating in the dining car oE a train. 
The waiter brought him a large bowi oE bean soup. 
Suddenly the train screeched to a stop, 
the soup spilled in John's lap. 

Wow does the reader comprehend the final sentence of this 
narrative? Under current models of sentence integration* the 
noun phrases "The soup" and 'John's lap* will be used as search 
cues to find earlier* related information. Both of these cues 
will guide the search back to the second sentence* where 
reference is made to John and to the soup. As a result* 
according to current models* the last aentence will be integrated 
with the second Sentence, 

This procedure* however* misses the crucial causal link 
between the third and fourth sentences, TJ»e antecedent search 
process does not help in finding this causal link because of the 
lack of argument overlap between the third and Eourth sentences 
in the text. The question* then* remains of how the reader does 
decide to consider generating a link between the third and fourth 
sentences in the absence of argument overlap. 

A complete answer to this guestion must await a theory of 
causal inEerencing, It is possible* however* to speculate about 
mechanisms that might be useful in guiding causal inference. One 
possibility is that the reader is using expectations to guide the 
process of finding causal links. IE the reader has an 
expectation that a particular sentence contains a causally 
important event which will be immediately followed up by the 
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writer, then that sentence Is a likely locus for Integrating the 
neit r.cntcnc*, regardless of where else the antecedent search nay 
lpad. Consider the third sentence of the train teit? "Suddenly 
the train screeched to a stop-? This sentence seems likely to 
play a causal **>l t % in the events to const It Is the kind of event 
which Is likely to have causes and/or consequences~which are 
Important to the narrative. It 'is also the kind of event that 
should be Immediately followed up by the writer If the narrative 
Is to be v ell-formcd. Thus It Is reasonable to hypothesise that 
the reader's response 40 ouch 4 sentence will be to fot« an 
tiptrtatlon that upcoming sentences will relate to It. 

CI ic ill no an Expectation 

what kinds of events elicit eipectstlons thst they will be 
followed itp7 The likely candldstes are events which violate a 
currently active script tSchank t Abelson* 19771. For eismple* 
trains do not typically screech suddenly to s stop. The event 
violates the 'riding a train* script and It does not fit the 
"restaurant" script that May also be activated. As a result* the 
reader can Infer that this event nay be causally Important, it is 
alito likely that certain kinds of events access causal 
connections In long-ten memory. For example? the reader 
probably has stored in memory Information about the general 
concept of a sudden change In the velocity of a Moving object. 
This general concept has strong links to likely causes (e.g.* 
hKtlnq a barrier? an agent applying brnkes, etc.) and 
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consequences? e.g., (the displacement of supported objects). As 
soon as the train event Is recognized as an Instance of the more 
general concept, the reader haa access to causes and consequences 
that Suggest the event could be causally Important (see FahiMan* 
1979* for some Ideas about Modelling hierarchies of actions with 
cause and consequence Units). 

In contrast suppose the key sentence in the train text Is 
changed so, the whole text now readst 

John was eating In the dining car of h a train. 
The waiter brought him a large bowl of bean soup. 
The train slowed ent<» Ing a station. 
The soup spilled In John's lsp. 

The teit no longer contains a causally important event prior to 
the lsst sentence. The slowdown of the train is a normal event 
accounted for within the train script. Furthermore it ,does\not 
seen likely to access a long term Menory concept node whicty'is 
bristling with cause and consequence lfnks. It should be/clear* 
then* that the eipectstlons discussed here are generated 
selectively* not for every sentence of**every teat. 

In short* s general expectation tftst More will be ssld about 
a particular set of proposftlons is elfcited when those 
proponitions sre perceived to be of Immediate causal Importance, 
in Its most qenefal form* this type of expectation consists of 
the tagged text propositions which need to be followed up 
Immediately, These tagged propositions may be linked to a number 
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of [tangible caua?s and consequences activated In long term, 
urinory. The set of tagged teit proposition's plus the activated 
conrcptn will be referred to as a general eipectation. It la 
general In the sense that a number of possible neit events will 
fulfill the expectation. 

in addition to this general expectation? the reader m&ybn 
jil> I e to form a very specificprediction about the neit event In 
the narrative. For example* for the train teit the reader may be 
abie to predict that the soup will spill. Making this prediction 
involves the specific Instantiation of one of the general causes 
and consequences activated for the event* the consequence of 
object displacemeot. Thurw the generation of a specific 
prediction may be viewed as a two-step process In which a general 
cipectntton in generated first? and then one aspect of that 
expectation is further specified. 

It should be pointed out that the reader will not always be 
able to generate a apeciflc prediction. For eiampie? suppose the 
key sentence in the "train teit is changed to read? "Suddenly 
there was a high-pitched electronic tone." This Is certainly an 
event likely to be followed up in the teit* The writer must say 
something about its causes or consequences. Thus the reader is 
likely to form a general eipectation as described earlier? bub is 
unlikely to generate a specific prediction., 

Tbe Role oi EjpeciflLtjjjna in fiejuejjee integration 

The model to be developed here assumes that readers 
regularly form expectations (general and/or specific) as they 
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read narratives. Once formed* an eipectation is used in the 
attempt to integrate upcoming sentences. Specifically* the 
content of the eipectation is given priori*^ in the reader's 
search for a causal link between the neit sentence and the 
slresdy-read teit* h prediction follows from this account: when 
the reader has generated an eipectation that should be 
immediately fulfilled* an attempt will be made to create a causal 
link between the upcoming sentence and the eipectation. This 
attempt will be made even in the absence of argument overlap. 
For eiampie? upon reading that the train suddenly stopped? the 
reader will attempt to find a causal relation between the 
upcoming sentence and this event* If the reader has formed a 
specific prediction? this process may "Involve an attempt at 
relating the., sentence to the prediction* If the reader, only has 
a general eipectation? the process may involve constructing a 
relation between the sentence and the teit propositions tagged as 
part of the eipectation. , 

The eipectation Identifies that subset of teit information 
which should be relevant to integrating the upcoming sentence. 
If the eipectation is correct? then a causal link can easlly'be 
created? and the reader can bypass some of the search and 
lnferencing that might otherwise be required. If the eipectation 
is incorrect, then the link between the upcoming sentence and the 
teit will not be so easily found because the reader will waste 
time trying to find a causal link where none eiists. 

Three eiperiments are reported which test the major' 
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hypotheses about the cole of expectation/I in sentence 
integration. The first two expec iments teat a general claim of 
the model without distinguishing between general and specific 
expectation!!* This claim is that an expectation provides a focus 
tor current causai inferencing and as a reault fa given priority 
in the attempt to integrate upcoming sentences with the prior 
text* Experiment i tests the hypothesis that an expectation 
helps in the attempt to integrate when it Is correct* 
Experiment 2 tests the hypothesis that an expectation Interferes 
when incorrect. Finally* Experiment 3 turns to thi general vS, 
specific distinction* It examines the content of the expectation 
itscifr testing the hypothesis that readers are actually forming 
specific predictions (e,g,* the soup will spill) whenever 
possible an opposed to more general kinds of expectations. 



EXPERIMENT 1 

in this experiment subjects read a series of short text 
fragments, At the end of each text* they were asked to judge 
whether a target sentence was a possible "next sentence" for the 
t***f. Response time to the target sentence was the dependent 
variable. Texts were designed either to elicit or not to elicit 
an expectation at the sentence immediately preceding the target 
sentence. Response time to the target sentence was expected to 
reflect processing in the presence or absence of an expectation* 

h set of text fragments similar to the train text was 
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created. Each text was built around an everyday activity for 
which the reader might have a script (e.g*r riding on a train, 
fixing food in a restaurant* hiking in the forest), each text 
had a High Expectation tniE) version designed to eilcit a strong 
expectation that Certain sentences would be followed up. 
Expectations ware created by including a kej causai event (e.g,r 
the train screeching to a stop) or by including a causal trait 
(e.g,r anger) accompanied by appropriate enabling conditions 
(e,g,r using a knife in the kitchen). The key causal sentences 
depsr ted fro* the script and wlii be referred to as the 
expectation sentences. To cQFat^ the Low Expectation (LoE) 
version of each text the -expectation sentences were modified so 
that they fit in with the normal* script events of the rest of 
the text. 

For each text two target sentences w»ere written* one 
sentence followed directly from the expectation sentences In the 
HlB version of text* the other sentence was designed to be 
unrelated to the text* Examples are given in Table i* The 
judgment task was intended to be a simple one for the subjects. 
As a result Unrelated targets were chosen to be obviously not 
related to any propositions mentioned earlier in the text. 



insert Table 1 about here 



If expectations con provide a focus for causai inferencing* 
then response time to the target sentences for the HiE texts 
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should ho faster than for the LoF In both Related 'and Unrelated 
rondl t lbnn. The reasoning behind this prediction In tj*c Related 
condition should be clear. For the MlE texts subjects have 
focunctf on certain propositions which are exactly ttiose needed 
for rhp causal Inference allowing Integration of the Related 
npntencc. For the LoE texts subjects have no such focuflr and 

therefore they must search through the text to find appropriate 

j * 

Information to allow Integration* 

The prediction for the Unrelated condition follows the pome* 
sort of reasoning. In the HIE condition the reader attempts to 
relate the sentence to the expectation. Upon finding no relation 
the render can safely judge the sentence as Unrelated. This 
allow* the reader to respond without taking the time to search 
the rest of the text for possible relations. In the hoE 

condition the reader does not have such a focus and thus ftuet 

t 

scarcli more of the text before determining that the sentence Is 
i ndeed unrelated. 

The Unrelated condition Is crucial Cor ruling out two 
Important Alternative hypotheses which could fully account for 
the predicted pattern In the 1li£-Related Condition. The first 
hypothesis Is a backward Inference hypothesis. Suppose the 
reader does not generate any expectations at all for a text. In 
order to Integrate the Related sentence? some lnferenclng must be 
carried out to determine the causal link between prior text 
Information and the sentence. The caudal antecedents are much 
more likely *g causes In the HlE texts (e.g.* a train screeching 
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to a stop In a much more obvious cause of soup op^l 1 1 i ng than is a 
train slowing tu enter a station), pis a tynullt It Is reasonable 
to expect that the Inferences necesnary tfr determine causality 
(and hence to find a relation) will be more quickly made In the 
fflfj condition for the Related sentences. 

This alternative hypothesis, however, would have trouble 
accounting for a difference l*i HIE vs. LoE response t lmes In the 
Unrelated condition. Jhe target sentence In this condition bears 
no caueal for referential) relation to any sentence In either the 
ME or LoG versions of . a text. Thus a backward Inference 
hypothesis which claims that no prior Information Is given 
special focus would predict no difference in response time, if a 
difference Is found r It will lend support to the claim that at 
least some of the effect In the Related condition Is due to the 
presence of an expectation. * 

h second hypo thesis will also be ruled out given an effect 
In the Unrelated condition. This hypothesis claims that an 
expectation Is elicited by every text. Thls~ hypothesis Is 
reasonable- If It Is assumed that expectations are simply concepts 
activated automatically for every sentence, h pr edict-at-every- 
senteiice hypothesis could account for a Hie vs. hot difference in 
the Related condition In the following way. For the II1E version 
of a text the expectations generated are likely to be relevant to 
Integrating the target sentence; for the We version the 
expectations are unlikely to be relevant (e.g.* for the LoF train 
text expectations might center aroujid passengers getting on and 
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off at H>p ( ot at lonJ . The hypothesis oannnt predict art effect In 
tho Unrelated cnndltlon because the expcetatlons £ or both the llic 
an LoR textn vould be equally irrelevant to attempts at 
Integrating the Unielated target sentence* 

Methortfl ^ 

£ubj*£t£* Tw*Wy-four subjects from the University of* 
Michigan community participated* Each was paid $3*50 for a 30 to 
4o\qlnute session. 

Hat filial^ The texts were 40 ehojt narratives* Each text 
was Incomplete and could be considered the beginning of a longer 
story. Fach t*>Jtt had tyo versions as shown in Table 1. In one 
version the'rcnricr was given one or two critical pieces of 
information intended to elicit on expectation at the end of the 
text (the expectation sentences)* This version is the HIE 
version of the text. In the other, vers ion of each text, the 
expectation sentences were modified to be less likely to elicit 
an expectation at the end of the text* This second versi<yi is 
the t.oC version of the text* 

For each text a Related target sentence was written. These 
sentences were eight to ten syllables long* >tfith a mean length of 
9.1 sytlahlea. The sentence always directly followed from the 
expectation sentences In the Hj,E version of the text* Argument 
overlap between the Related sentence and both versions of a text 
was always the same. 

All texts were then paired such that the Related target 
sentence Cor one member of th« pair could be usejl as the' 
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Unrelated target sentence for the other menber of the pair. This 
i 

pairing was not random; care was taken to insure that there was 

no argument overlap between text and Unrelated sentence and that 

the Unrelated sentence for a text was as convincingly unreluted 

i 

as possible* The result of'the pairing was a set of stimulus 
Materials in which each text and each sentence appeared In all 
possible conditions* 

pcslgii. There were Tour experimental conditions formed by 
the crossing of text version fHlG vs* LoE> with target type 
{Related vb* Unrelated), h given subject saw ten texts In each 
of that four conditions* Across the full experiment eachjrftt and 
each target sentence appeared equally often In all four * m 
conditions* although for A given subject each text and target 
sentei appeared in only t>ne condition* 

Procedure. The experiment was controlled by a Digital PDF 
11/34 computer. Subjects were run Individually, in soundproof' 
booth?* The texts were displayed on a Hewlett-Packard 2621a 
Interactive terminal connected to the computer* Subjects 
responded by pressing keys on a keyboard In front of them. 

Each subject read all{i0 texts plus an additional ten 
practice texts which were placed at the beginning of the 
exper lment * ' 

Subjects began the experiment by pressing the space bar on 
the keyboard. The first text was displayed in full on the CRT* 
Subjects had unlimited time to read the text* When they had 
finished reading^ subjects again pressed the space bar. 'The text 
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war replaced t>y a single target sentence. Subjects read the 

route nc« and decided as quickly as possible whether it was a ^ 
rf*anosiahic next scntcnoer uulro the V" and "X" Keys to lnd^ate 
theU response. After subjects "responded* a feedback message 6 
appeared or\ the CRT for 1000 msec, the feedback Message was ^ 
automatically replaced by a Message telling the subject to press 
the rpoee bar for the next text. 

SutiJco£s were Instructed not to deliberate over the target 
sentences* but rather to respond as quickly as possible but not 
no fast that 'they made lots of bad judgments. They were told 
that they should- respond *Ye«* if the sentence was a possible 
next sentence* *No* If it was not. It was eftphaslied that 
subjects should not worry about whether It waa the beet possible 
next sentence. ^* 

Because t(»e criterion for deciding that a sentence, was 
Felatcd or Unrelated might be expected to vary from subject to 
subject* feedback was given as guidance for setting the 
criterion. ftelatedness judgments about the target* sentences had 

a - t. ' 

been informally collected from colleagues. When © subject's 
response agreed with the judgment of this earlier group* the word 
ACRES appeared on the screen. If a response disagreed, DISAGREE 
appeared. 

t 

a 

ftenulto * 

. Tot each subject a mean response tisre to the target sentence 
was calculated for each of the to+t conditions* and for each text 
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a n*an response time was calculated for etfch of the four 
conditions. These mea^a were used as the observations In the 
analyses* Trials In which subjects disagreed with the expected 
judgment were excluded from the calculation &i these Means. In 
addition trials »bre than 2.5 standard deviations from * 
subject's mean for a given response type '/Yes" and "No") were 
excluded as outliers U.9I of {he data).- Teats based on subject 
variability will be referred to as Z it those baaed Qn item \ 
variability will be referred to as )Lj- Planned comparisons are 
based on subject variability! the Bonferroni i procedure la used 
with the critical algniflcance level adjusted according to number 
of comparisons Made* 

flean t*sponae tiaiea and dlaagr teaent rates foe each 
condition are displayed In Table 2. In the analysis of response 
tines* the effect of text version waa significant I subjects were 
faster to respond to the target sentence w4>en It fot loved a tite 
text than */hei» it f^Uowed a Lot te*t (£i(l,23) - 60.46, \ 
P < *00t** HSe - 137351 Z2' 1 * 3> > * 35,04, u < ^0001. Use - 
934'/0), In addition the interaction of text version and target 
sentence type was significant tr 1 Ut23) - 20.60, jp < .0004, HSe * 
31632* £3(1.39) 0.74, p < .00€, HSe - 154996), Planned . 
comparisons revealed that the mean response time to the III 
Belated target aentencen was slgnif lcantly faster than the moan 
response time to thi LoE~Related target 'a*nhenc*es (t 123) ■= 6.74, 
U < .0001). The mean response time to the fll E-Unc elated target 
sentences was faster than the nean response time to the poE- 
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_ U»rf»latpd tar,jrt urntcnces (U23) * 4.32, U< .0005) . ' 

' insert Table 2 about ***** 

In the analysis of disagreement rates* the effect of text 

version vne significant. The probability of disagreement was 

^vjher tot the target sentences following the file texts than for 

nentences following the LoE texts t£itl*23) * 6.95* & < .007* MSe. 

* 56r f 2* 1 "' 39 * " 7*B9* fi A < 006* MSe - 107), The Interaction of 

text version and target sentence type was significant (£^(1*23) - 

10.99, p < .004, HSe - 97i " *4.06* 0 < .001 * HSe - 

126). The disagreement rate for the LoE-Related condition was 

olgnlllcant ly higher thari the loE-Unrelated condition (H23) * 

2,67* £ < .01) and higher than the ME-Rel«ted (1(23) * 4.13* 

p < .001). The HiE-Unrelated and LoE-tinrelated did not differ 

slgnlllcantlyr nor did the lilt-Related and the UlE~Unrelated. 

Reading times fo* the texts themselves were compared for the 

HIE and the toE conditions* Two kinds of analyses were 

conducted. First* for each «A>Ject the mean reading time for the 

lllft and for the toB conditions was calculated. A paired 1-teet 

shoved no s^gnlllc&nt differences In (These means (1(23) -« .05)* 

The text versions do differ* however* In mean len^thl the DIB 

versions have a Van of 46. B5 syllablesr the hoE a mean of 43.02 

* 

syllables, ab a reeult*a second analysis was conducted which 
took syllable length Into account, for each Subject two 
regressions were carried out* one for the ItlE texts* one. for the 
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l.oP. the dependent variable was reading time" for the text 
version! the Independent variable was the number of syllables In 
fhe text version. Analyses of the resulting Intercepts and 
slopes also reve~ale^l no significant differences fo* the HIE vs. 
IqE conditions (Intercept analyslsi 1123) ■ -i05l slop* 
analyslsi 1*23) - -*31). 

Discussion 

Subjects Here faster to respond to both the Related and the 
Unrelated target sentences wheh they followed a II f B text. This 
pattern of results Is consistent with the general hypothesis 
Introduced earlier. A correct expectation provides a focus for 
cauoal lnferenclng* presumably allowing the subject to bypass 
some of the processing normally required In the attempt to link a 
sentence to those preceding It. The results also support an 
assumption made about this type of expectation! such „ 
expectations are generated selectively*, and not* for every 
sentence of every text. 

As argued earllef* the Unrelated condition Is Important for 
providing evidence against two plausible alternative hypoth'earat 
the backward causal Inference hypothesltj^and the predlct-at- 
every-aentence hypothesis* while both hypotheses can predict the 
pattern of results found In the Related* trondlt Ions* these two 
hypotheses cannot predict the A^ference found In the Unrelated 
condition* 

Because the Unrelated condition la a critical one* It la 
worth considering what relation It has to situations typically 
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encountered during "normsl* reading* It i»hb clear that akl 1 Led 
rtaifora frequently encounter aentencee In atorles which vary In 
how strongly they srs predlctsd by the previous tsst Is. 9.* MIC- 
Delated vs* Lot Related!* Good writers* however* da not 
dellbersteiy Includs Unrelated sentences In thslr testa. 
Neverttieleea It Is likely that resdsrs have esperlenced the 
phenomenon of encountering s seemingly unrslsted sentence* 
frequently a sentence Is read wltti less attsntlon than It 
feeftervee* and a word la mi sldentl fled or a phrase Incorrectly 
pereert. Sometimes s sentsnce Is actually smbtguous* snd the 
wrong interpretat ion Is chosen by* the reader* Such, ambiguous 
' tests hsve been studied by Coll In*, Drown snd Larkln (1980) and 
by Dumelh*rt (Note 3>* As a result of misinterpretation of the 
early ambiguities In such tests* s Ister sentence will seem 
incongruous ot unrslsted. 

Skilled readers most be sensitive to such Incongruity 
because It la a good Indicator that the comprehension process hsa 
failed and remedial action Is necessary, por esample* It may be 
neoessary to rersad earlier sentences to find where the 
misreading occurred* or It may be necessary to reinterpret an 
earlier sentence which Is In fact ambiguous. Skilled readers 
muot have procedures (or detecting and correcting such instances 
of miscomprehension* in fact detailed protocola of such * 
corrections were collected by Collins et si (19&0> snd by 
Rumplhart (Note 1), It seems* then, that the task used here can 
be espected to tap those Tprocedures readers normally use' In 
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rssdlng. Ons conclusion to be drawn from ths results Is thst t%n 
espactstlon csn help s resdsr cstch comprehension problems* 

Thsrs Is* hnwever, s major difference betwsen ths resdsr'a 
responss to sn Unrslsted tsrget ssntencs In the Hit condition and 
to sn Incongruous sentsncs encountersd In normsl rssdlng* in 
this experiment ths Unrelated sentsncss wsrs not euppoaed to fit 
In* snd ths subjsct knew that. As s reeult* when the subject 
encountersd * tsrgst sentence thst aid not rslete to the 
espectatlon* It wss s good bet thst ths sentence must be 
Unrelated* On this beale* trie subject could msks a "Ho" 
response* making no further sttempt st Integrating ths sei^mjence, 
In normsl raiding, of course* rssdsrs would tske the time to g<» 
bsck flgurs out whsrs the mlsrssdlng occur tad snd how ths 
Incongruous ssntence actually fit In* 

One notable character I at Ic of the results la the fact thet 
the difference between the mean response time for the HiG snd L*o& 
condl t Ions Is sbout 3' 1/3 time a larger In the Delated than in the 
Unrelated condition* Two complementary ac^unta of thla 
Interaction can be given, riret. It la likely that the MIC 
reaponae tlmea conelat of a m \n of *t least two different fclntln 
of trlalat trlale on which the appropriate espectatlon Is formed 
snd trials on which no espectatlon la formed* In the Delated , 
condition s fester response is especteo* for both types of trials* 
given the predictive snd backward lnferenclng processes described 
earlier* In the Unrelated condition* however* the latter type of 
trl si (where no espectatlon Is formed) will not resul t In a 

/ 
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fowtf-r i>»| o#. a ftsttr rttpontt will occur only on thots HlC 

ttltl* vli*m sn fmjxrrtstlon la formtrd, Hsncs ths proportion of 

f«nr t r I a I it It lowsr In I ht Uiirslstsd condition, 

I 

A fond posslbl* rn«on for ths Interaction In rssponsa 
M**^ Is suwissted hy thi snslysls of dlssgrssmsnt rttst* It 
nrvmt to hii us per I f I ly difficult to dsrlds on * f ssponss for a 
Hi r ln»ftl tsrg*t smtenrs *hsn It follow* • toE test* In this 
f million *utj}*i-tt will OHscovsr srgumsnt overlap bstwssn tht 
tai<|*t ifhtenrt and the tsstl this sugo,ssts that * rslttlon 1* 
fMP»nlhlii r Tht csussl Link* required* howswsr, sfs much Isss 
Ilfcely than In tht Hir-fleletsd call. As a rsoult* tht decision 
>mgp ss I I sa tht ses r ch tnd Infer eocs stsgsmsybs 
lrn T |th<*n*d. for sssmple, subjects msy spend sstrs tlms deriding 
vhr-Hirt the causal relation they htvt Inferrtd betwssn the trsln 
Mowing down and the soup spilling la resaontbls enough to allow 
a ttolsfr fd i eflrmnne. 

One scrtltlnnaL hypothesis might be proposed to account for 
thr overall pattern of rssults In this esperlmsnt, Thli It a 
"ornrral arousal* hypothesis* Under this hypothetlt* £hs HIE 
tracts do not elicit specific expect at I ons, ftather* they prime 
niiLjrcts to respond faster to whatever stimulus nest appears* 
This hypothesis \ B dlfflc%lt to epeclfy* but It la baaed on the 
observation that In this esperlment subjects are alwaya faster to , 
thf H I E toilets no matter what relation *slsts between target tnd 
tpxt. One rould rblm that the Hie: tests somehow Leave subjects 
in n 'higher state of arousal*' and thus response time lA alway* 
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fseter* Ttila altttnttlva hypotli*ala la rulad out by tht rssulln 
of Espsrlmsht 2* 

t*rr* incut 2 

tha raavlta of Ksperlmsnt 1 provide support for tht clslm 
that tspsctatlona srs formsd during r fading* that thay srs for*** 
mslsctlvsly and not for svery t**t> snd that thty can bt uasd In 
tha sttsmpt to rslsts ths uppomlng eeotancs to tits prsvlotis tstt. 
In Ksperlmsnt K subjscts tfsrs rssdlng with ths assumption that 
thsy would sncoontsr tturslsted esntsncse. As s rseult, thay 
could Pafcs uss of their sspectatlona to quickly reject a targst 
eeritsncs which bors no obvlbue rslstlon to ths sspectstlon. 
Suppose* howevsr* subjects ware reading with the assumption tnat 
til esntsrtcss could bs lotsgaetsd Into ths tsst rsprsasntation 
Uhs asaumptlon msds for normal reading). How ml9ht the prssenr* 
of an espactatlon offset integration procsssss fot a oentence 
which was r slat ad to ths tsst but whl-h did not fulfill ths 
expectation? Ssperlmont 2. wea dsalgned to sddrsaa thla qusstlon. 

If sspectstlons slwaya bscome Involvsd In the attsmpt to 
tntsgrsCs tha upcoming eentsncs* thsn tlms »ey be waatod In 
procssslng a asntence which does not rslsts to ths sspectstlon. 
Thus an Incorrect sspectstlon s>lght be etpectsd to Interfers with 
ssntence Integration, Thla hypothssla will be referred to aa the 
Inter ferencs hypothesla, t 

Tor esample* coneldrr thfr following modi flcat Ion In, the last 
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sentences in the train tcxtt 

Suddenly the train screeched to a stop. 

The waiter Pffered John some coffee* 
How in the jast sentence processed? According to the 
interference hypothesis, an attempt will be made to figure out 
how the waiter offering coffee lelates to the train screeching to 
a stop. This commitment to try to relate incoming sentences to 
the expectation is'costiy tin processing time) when there is no 
relation intended by the writer. Thus this hypothesis predicts 
slower integration times for sentences which violate *n 
exppct at ion. 

An alternative to the interference hypothesis Might claim 
that expectations are available to be used if relevantr but they 
do not become involved in time-consuming processing If irrelevant 
ot incorrect. Under this viewr expectations might consist of 
concepts automatically activated in long term memory. The script 
i. activation model of Bower, Black and Turner J1979) 1b a model of 
thts type. In this type of model a script event encountered in a 
text Id assumed to activate upcoming events in the long term 
memoty representation of the script* These activated eventtfr ot 
expectations can help In processing the next text event, but if 
the next event i-s not a script eventr the activated script events 
tfo not interfere with sentence integration. 

Consider how this hypothesis might account for processing in 
the train text. When. the final sentence Is the *vent of soup 
spilling/ the Concept "spill" is directly related to one, of the 
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concepts likely to be activated as part of the expectation (e.g.r 
'displacement 4 Is one of several causes and consequences 
activated as part Of the general expectation)* Thus the 
expectation will become involved in processing through activated 
long term Memory pathways. In contrastr when the final sentence 
is the event of the waiter offering coffeer the expectation will, 
not be accessed because the concepts in this sentence have no 
direct relation through long term memory links to the 
eftpectat Ion. 

A second type Of non~inteff erence hypothesis could also be 
developed. Host narratives convey some script Information as 
well as major events which form the causal chain* The reader may 
first check whether the current sentence relates to the active 
Script and if It does notr only then go on to checfc its role in 
the causal chain ti.e. r Its relation to the expectation). This 
fecount would also predict that the expectation would not Become 
involved in processing the sentence in vhich / waiter offers 
coffee. 

Experiment 2 was designed to distinguish between the 
interference and the non-Interference hypotheses. Texts similar 
to those used in Experiment i were constructed. As In Experiment 
1, each text had a script activity as a theme. The 111 E version 
of each text contained sentences designed to elicit an 
expectation that they would be followed up. In the LoE version 
these expectation sentences were modified so that they did not 
elicit strong expectations that they would be followed up. For 



201 



, Expectations and Sentence Integration 

the II 1e version, two pairs oE target sentences were wrltteni an 
expected (Exp) pair and <m unexpected (Unex) pair. Examples are 
glvrn in Table 3. The expected target sentence pair followed 
Erom the expectation sentences In the 111 C version (soup spilling 
in John's lap)! the unexpected target pair was a normal event in 
the script (the waiter oEEerlng John coEEee). The sane target 
sentence pairs were used Eor the LoE version. The labels 
"Expected* and ^Unexpected" will be used throughout* although it 
should be clear that neither label actually applies to the target 
sentence* when they Eollow the LoE versions oE the texts. 



Insert Table 3 about here 



Both the Interference and non-interference hypotheses 
prrdlct Easter reading tinea Eor the BiE-Exp target sentences 
than for the LoE~Eftp. only the interference hypothesis* however* 

predicts that processing oE the Unex target sentence will be 

i 

slowed when an^expectat ion is present (i.e.* reading "time Eor the 

-i J> 
target sentence in the HlB-unex condition will be^slower than in 

the f.OE-Unex). The non-interference hypotheses predict no 

differences in integration time Eor the target sentence In the 

IIIE-Unex vs. LoE-Unex conditions. 

It should be noted that a backward Inference model will also 

predict no diEEerences in the Unex conditions. Consider again 

the -train text example. Tor both the Unex conditions antecedent 

search processes will lead back to the point where the waiter 
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served John earlier. The target sentence Is easily integrated 
with this earlier information because it Elts reasonably with the 
Restaurant script. In neither condition does the target sentence 
relate directly 1 to any later sentences. Thus a backward 
Inference model will predict no differences in integration time 
Eor the BIE-Une* vs. LoE-Unex conditions. 
Methods 

Subjects. Sixty-five subjects Erom the University of 
Michigan community participated In this experiment, of tftls 
^ number* 49 participated in a rating task to validate the texts* 
16 participated In the reading t^* e experiment. Subjects were 
paid $3. 50 Eor an hour's participation. 

H aterlalo- Twenty-four oE the texts from Experiment 1 were 
revised to meet the requirements oE both Experiments 2 and 3. 
Each text was rewritten so that the HI E ver si on of the te xt 
elicited much stronger expectations than did the LoB verslori. 
Furthermore* Eor each text a specific prediction could be 
Identified* This prediction Involved a non-human argument 
mentioned earlier In the text (e.g.* soup)* and was not highly 
semantically related to the Information unique to the HIE version 
of ft he text (e.g.* In Isolation* a train screeching to a stop is 
not semantically related to soup spilling). 

In order to rewrite and validate the texts* a preliminary 
rating task was run. Subjects were run in groups of two to aix. 
Bach subject was given a booklet containing one version oE each 
oE the 2<Ttexts. Subjects were asked to write a sentence 
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conveyln^-wtrSt^was moot likely to happen next and to rate how 
likely they thought their predlct*lnn was. A Elve-polnt scale was 
used. A rating oE one Indicated a "strong" prediction ("The 
reader baa been set up £o expect this event to occur*")* A 
rating of Elve y ndlcated a "weak" prediction ("The reader cannot 
tell what mlghL happen next."). Subjects were Instructed to guess 
IE they did not Eeel they could predict what would happen, and to 
lire the rating to Indicate their lack of certainty. 

* Initially, the result* Erom the rating task were used as a 
guide Eor rewriting the texts. The data collection and rewriting 
were carried out lteratlvely. Some texts required no rewrltlngr 
some required one or two rewrltlngs. As a result* the number oE, 
subjects actually responding to the Elnal versions oE each text 
varied. But no teat had Eewer than six subjects responding per 
Elnal version. §4 

For Experiment 2* the analysis oE the ratings Is central 
(other analyses will be discussed for Experiment 31. Ths mean 
rating lot the 11 1 B version^ oE the texts was 1.671 the mean 
rating Eor the hot versions was 2*92. The ratings differed 
slgnlElcantly (tm> - -10.1* & < *0001>, confirming that the Hie 
texts do elicit stronger expectations about upcoming events* 

For the Elnal' versions oE each text* two sentences were 
written as the target sentences! (see Table 3h The Expected 
target sentences (Exp) Eollowed Erotn the expectation sentences In 
the irlE versions oE the textr the Unexpected target sentences 
(Unex) did not. Theftarget sentence was always 11 syllables 
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long. An additional sentence oE elgHt syllables (the secondary 
target) was wrltteri to Eollow the target sentence In case 
processing tended to spill over to the next sentence. 

The Cap target sentences always conveyed Important events In 
the story. The Unex target sentences conveyed unimportant events 
which related to the information contained In the portion oE the 
texts which the III B and hot versions had In common* That Is* the 
antecedents Eor the Unex sentence always appeared In identical 
sentencea In the HlB end LoB versions oE a te»ti the links 
joining the Unex target sentences to the text were Intended to be 
the same In the two versions* 

BflMlapj Bach subject read one version oE each of the 24 
texts. There were Eour experimental conditions Eormed by the 
crossing oE text version (11 it: vS. hot) with target type (Bxp vs. 
Unex). A given subject saw all texts In each oE the Eour 
conditions* Across the Eull experiment each text appeared 
equally oEten In all Eour conditions* A different random order 
oE presentation oE teits was used Eor every Eour subjects. 

Procedure T The experimental equipment was the same as In 
Bxper lment 1* Texts were displayed one sentence at a time on the - 
CRT. Subjects controlled the presentation oE each sentence by 
pressing the space bar on the' keyboard In front oE them. Each 
press oE the space bar caused the current aentence to be erased 
and the neit sentence to be displayed* Subjects read through the 
whole text Including the target sentences! theVarget sentences 
were not identified In any way. AEter subjects had read, the 
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secondary target, sentence* a test sentence was presented* 
bJtfnaled by a large arrow which appeared aboge It* Subjects 
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Indicated whether the sentence was true or false of the text they 
had just read* responding by using the "I* and */* keys* The 
test sentence was Included to sure subjects were actually 

reading for comprehension. Vhe test sentence was always s 

shortened version of the expected event for the HIE version of 

- * 

the text. Feedback was given after the response. 

Subjects read a total of 56 texts. Twenty-tour w,*re the 
experimental tents. Eight texts At the beginning were practice 
texts, ' Twenty-four filler tent* were Included to dilute the 
Impression that highly unexpected events happened frequently. 

4 
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ns vere^computed as In Exper lmejf^ 1. Hean reading times 



fbr the. target sentence for eacb condition are given In Table 4. 
The means were submitted to two Overall ANOVAs. In the ANOVA by 
subject/ subjects w^ere nested within group (defined by four 
different assignments of tents to condl t Ions)) k both factors were 
croa&etf with text version (HIE vs* LoE) and sentence type tExp 
vs. Unex). in the A NOVA by texts* sentences were nested within 
both text grtfup and sentence typef all three factors were crossed 
with text version. In both analyses the text version by sentence 
type, interaction was highly significant (Ei<l,15) « 13.21r 
y < .005* MSe - 7l(lfj2l E 2 <l*4 ft ) * 25.61* fi < .001* MSe - 51438)* 
In the text analysis fche Interaction of text, group and text 
version was significant <E 2 (3,40) E 4,21, fi < .05, MSe » 51438). 
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No other effects were significant. 



Insert Table 4 about here 



Planned comparisons were used to examine the*lnteractlon of 
text version and sentence type. The Bonferronl t procedure was 
ueedi with a critical significance level of .0125 for each 
Individual comparison. For the niB versions, the Exp sentences 
were faster than the unex (tt!5) ■ 3.26r fi < ♦Olh For the LOE 
vet el one i the difference in reading time tor the Exp vs. unex 
sentences wis marginal at best (^(15) » 2*63r fi < .025). For the 
Expected target sentences reading time was faster following the 
HIE text versions ttU5> * 4*06* fi < .005). Flnallyr for the 
Unexpected target sentences the reading time was faster following 
the LoE text versions CtClS) * 3.11* fi < .01). 

The mean reading times for the secondary target are also 

given In Tab^e 4* The means for the secondary target sentence 

have the same Interaction pattern ^as those tot the target 

sentence* The differences* however* are much* smaller* and the 

effects <were not significant* 

• Reading times for the If IE and LoE versions of the texts were 

also analyzed.. For each subject reading times for the sentences 

of the texts^vere regressed on number of syllables separately for 

the HIE and for the LoE texts. Two sets of regressions were 

carried out. The first included all sentences preceding the, 

* * 
target sentences except Sentence Ivfwhlch tended to have much 
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longer reading times). The second Included only those sentences 
unique to the Hie and Lot versions* It should be noted that the 
sentences unique to the HIE versions were Intended to elicit 
expectations. Ho differences emerged In either analysis. ^ 

Finally, the relationship between the ratings for each text 
and the reading time for the target sentence was explored. For 
each of the four condition** mean reading tine for the primary 
target sentence for a text was regressed on the mean rating for 
that text version. A modest relationship emerged within the 
regression for.ttL niirune* condition. The sloPe in this < 
regresalon was -34^.4 msec* Indicating that reading tjme 
decreased with increasing text rating (£(22) -1.94* C < .033)* 

filscusslon 

The most Important finding In this experiment is the effect 
of text version within the Unexpected, condl t Ion* This finding 
suggests that an expectation becomes Involved In the processing 
of the next sentence even when the expectation la unrelated to 
thla renterite. Furthermore* the Involvement of expectations can 
he rather costly* reading time for the primary target sentence In 
the irlft-Unex condition was Increased by 316 msec, tt makes 
reasonable the finding In experiment 1 that a skilled reader does 
not generate expectations for every sentence. Given the costs 
Involved* It Is most efficient to generate an expectation only In 
the presence of sufficient constraints In the text on future 
events. 
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The overall pattern uf results from Experiments 1 and 2 
suggests that expectations can both' help and hinder the 
Integration of later sentences. Specifically, expectations help 
when they are correct and hinder when they are wrong. An 
expectation seems to acquire a privileged status which gives it 
priority in the processing of upcoming sentences* whether it la 
relevant to integrating these sentences or not. How this 
priority might be established is considered in the General 
Discussion. 

The absence of significant affects, in the secondary target 

sentences makes reasonable one form of the immediacy assumption 

of Just and Carpenter (1980). This is the Assumption that 

processing for a particular sentence does not 'overflow* to the 

following sentences. The pattern here suggests tfcat integration 

processes for a sentence are carried as far so possible before 

going on to the next sentence. While the interaction pattern of 

the secondary target sentences was similar to that of ,the 

targets* no differences were significant. Thqo, if an overflow 

ex 1st s* it seems to have a pi nor effect on process ing time* 

especially in comparison to the effect of the manipulations on 

jthe processing time for the target sentencea* 

The fact that reading time, in the IHE-Unex condition t 

Increased with strength of expectation (as measured by the rating 

task) lends further Support to the claim that expectations are 

influencing reading ti*e in this condition* This correlation 

* 

seems to reflect ttfe degree to which readers have committed 
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Hipmeelvert l-o an expectation. The assumption la that the* stronger 
the ratlmj In the fating task* the more Ukeiy the subject In tht 

i 

rending msk in to Lou* an expectation about upcoming sentences* 
and the larger the Interference when the expectation It not 
f ii t f I lied, 

One final result worth noting la that* contrary to other 
Mndlngn In the literature (drllo ft Toaa* I960* Just ft 
Carpenter, 190OI* the Important sentences did not cona latently' 
take longer to read* The Exp target oentence* were aiwaya 
Important next sentences* the Onex target sentences were alwsps 
unimportant. The longtst reading times were for unimportant 
sentences which happened to be unexpected {the HiB~Unex 
condition). Within the LoE text version* the Important target 
sentences (Expl were only marginally slower than the unimportant 
(Unexl* This result la consistent with an analyals which , 
suggests that the effect of importance pn sentence reading, time 
la mediated by expectations! sentences which are Important snd 
expected do not have long reading times* 

BXPgRlflENT 3 

v Throughout, the term "expectat loQ* has been tiaed to refer to 
two kinds of cognitive phenomena* A reader who has formed a > 
general expectation has tagged certain text propositions as 
likely to be Immediately followed up by the writer snd possibly 
has activated some general elaborations on these propositions 
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(e*g*# general causes and consequences! » A reader who has formed , 
a apeclflc expectation has gone one step lurther anjl generated a 
specific prediction about opcomlng content. If readers lisve n 
general expectation* then preaumabl/ they are aet to encounter 
one of a range of poaalble next events In the narrative* Irf 
contract If readers have a specific prediction! then they at'e set 
* to encounter a* tingle next event* 

One reasonable model of expectation generation might be a 
two-step modal In which the reader flrat generatea s general 

expectstlon* enjjl then further specifies, the general expectation 

♦ 

If possible* For example, for the train text the reader forms a 
general expectation that more will be ssld sbout the causes 
snd/or consequences of ths trsln screeehlng'to s halt. The 
reader then goes on to genersts a apeclflc likely consequence 
bsaed on prior text Information (the fact that John Is estlng 
soup) ♦ 

There ere st least two treasons why Feeders artght not be 
regularly going on to form specific predictions once s general 
expectation Is generated* rirst* It seems to bs s general 
property of good nsrrstlves that, the specifics cannot be 
predicted, stories in which ths reader could predict exactly 
/what will happen next would be sstremely doll* ft Is unllfc*ly 
that good readers would sdopt s strategy of regularly generating 
specific predictions when these predictions are likely to be 
wrong* Second* the generation of s apeclflc prediction Is likely 
to require s fslr amount of proceoalng time* In the train text 
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♦lor rM,«*|rlrr lr ic-ijuliett e search of the teit for * J ikp J y object 
in hr Itiriit put ated Into the sapectstlon and an evslufttlon of the 
t andlitAtrtt found d.q.i wslten Jnhn, simp, ttcJ. The 
I Urrnture on antecedent aaarch suggautt that tha aaarch for and 
evaluation of a prior argument In a tait can ba t Ims-copsumlng 
(rlrlto, 19BH Clark 4 Bangui, 19791 Gar rod 4 Banford, 1*77). If 
this fa tha case, then. It seems to ba a poor strategy fnr tha 
reader to adopt, why alow down to predict what will happen neit 
rMher than simply reading on to firS o»|t what actually did 
happen next? ^ 

fewr the teifo used In Eiperlmenta 1 and 1 It was poaalble 
for tho reader to generate a epeclflc prediction for the HIE . 
version*. Eipprlment t tested the hypothesis that readers In the 
flint two eiperlnents were actually forming th**s highly specific 
prediction** The specify prediction elicited by the HIE teita In 

f*perlment 2 always Involved a target argument Introduced earlier 

♦ 

In the portion of the te it that was common to the ttlE and LoE 
versions (e.g., 'coup* In the train teifc). Eiperlment 3 probed 
the availability of that target argument. If subjects actually 
<*f>ner»te the specific prediction while reading, then the target 
argument shou I d be r et r 1 eved anjfcPfroul d be held In a highly 
available form as part of the prediction. As a result* target 
arguments uMch form part of a specific prediction should be more, 
available than they would otherwise be. in y£he absence of 
predictive processes?, the availability of an argumant has been 
shown to vary with the distance of ire last mention In the teit 
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♦ 

(Carpenter 4 Juati lf77i 19701 Clrllor 1 9fll I Clark 4 Bangui, 
Ifjfi La ago Id at al, 11791, In contraat If a prediction 
Involving the argument haa been madai than dlatance of laat 
mention should not Have an affect on availability. The srgumt-iti 
ahould be highly available regardleaa of dlatance. 

fn thla eiparlment each teit had four version*. The turn 
verajona of the train teit are presented In Table 3, Two fa*rom 
which ahould affect the availability of a target argument i+<ht 
aoupl were varied orthogonally* the dlatance of the argument'* 
laat men t Ion In the teit , and the degree to which the r eadei haa 
a specific prediction Involving the target argument* 
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Availability wea measured uelrtg a forced-choice teak* 
Subjects read the teita one aentence at a time. They were 
Interrupted at the point where an expectation ahould be generated 
for the HIE veralon of the teit. The target word was presented 
along with a dlatracter. Subjects Indicated which word had 
appeared In tha teit. ff the availability hypotheses are 
correct* then reaponee time for the target arguments for the ilic 
teita ahould ba faater than to the LoE. furthermore, dlatance 
ahould affect response time for the target argument for the Lot 
teita* with tha dlatant target requiring more time than the 
clone* No dlstsnce effect tor s reduced distance effect) should 
be found for the »je teita, Tbutf dlatance and teit veralon 
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should interact In their effect on response tine for the target 
argument * 

Methods 

&Uhj££iA* Twenty-six subjects fron the University of 
Michigan community participated. Two subjects were excluded for 
failure to follow instructions. Subjects were paid $3.50 for 30 
to 40 minutes of participation. 

H&JLfcllftlAj, The texts used In Exper iment 2 wer e used as the 
HiE-Close and LoE-Clos* versions of Experiment 3. In all of 
these texts the target argument appeared In the third to last 
sentence of the text. To create the Distant versions of *ach 
text; two filler sentences were inserted sonewhere between the 
last siention of the argunent and the end of the text. These 
filler sentences were ldent ical for the HIE and LoE versions of a 
given text. They did not refer to the target argument. Three 
sentence? back was chosen as the distance In the Close condition 
because pilot studies suggested that at a distance of two 
sentences beck the argument might still reside in verbLtim 
memory. The Close and Distant versions of the train text are 
given in Table 5. 

The HIE ver si oh of each text wasdesigned to elicit a 
specific content prediction involving the target argument. Care 
was taken to insure that the expectation sentences in the HIE 
version of a text were not highly semantically related to the 
target argument. For example* "soup - is not senantically related 
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to a train screeching to a stop except in the context of the full 
train text, As a result* the target argument could not have been 
made available in the 111 E version by activated semantic pathways 
rather than b/ predictive processes operating on the text. 

Ml four versions of the texts were validated In the same 
rating task described in Experiment 2. Counts were made of the 
number of Subjects who included the target word as part of their 
prediction of what should happen next. Texts were rewritten to 
insure that the HIE versions o* each text always elicited mention 
of the target word more frequently than the LoE versions. The 
final mean percentages of subjects mentioning the target argument 
were 90 for the HiE-Close, AT for the HiE-Distant, 55 for the 
LoE-tilose and 53 for the LoB-Distant. hn anOV* on the mean 
percentages for each text revealed a significant effect of text 
' version tEtlr23) ■ 97.0SY < .001)1 neither distance nor the 

interaction of distance with text version approached 
significance. 

For each text, a dlatracter word was chosen to be paired 
with the target argument for the forced-choice task. The 
dlstracters were words which had not appeared in. the text. They 
were alwaya the same length tin letters) and of similar word 
frequency as the target word. For the filler texts/ similar 
pairs were constructed with one member coming from the text and 
one not. *" 

The forced-choice procedure was adopted after^running a 
pilot experiment In which subjects were askW to make an, old-new 
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judgment for a single target word* This old-new probe task was 
similar tc a procedure used by KcKoon and Rat cliff U980r Dell* 
HcKoon 4 Ratcjlff* 1983)* The single-word probe task was. 
abandoned because It overemphailted^memory for the exact word. 
Some subjects reported making errors when they were unsure 
whether a target word or a synonym had actually appeared*ln the 
text/ The dlstracters In t|^forced-cholce task were chosen to 
be clearly unrelated to the text to reduce thla problem* 

P es Io n* Each subject read one version of -each of the 24 
texts. There were four experimental condl tlont> formed by the 
crossing 0 f text version (JJlE va* LoE) with distance (Close vs* 
Distant). A given subject saw texts In each of the four 
conditions. Across the whole experiment, each text and target 
word appeared equally often In each condition* Order of 1 
presentation of texts was randomised every four subjects* 

** Qgffjftil g*. Subjects read a total of 94 texts* Th{ first 36 
were practice trials* The remaining 48 were the 24 experimental 
plus 24 fillers. 

Subjects read each te*t one sentence at a time on a CRT* A 
press of tike space bar erased the current sentence and brought on 
the next* At some poipt In each text the next sentence did not 
appear when the space bar was pressed. Instead? a large down- 
pointing ar/ow (5 cms* high) appeared on the left side of the 
screen* After a 333 msec* delay, the test words appeared under 
the arrow. The words were displayed on the same line* separated 
by three character spaces* Subjects responded by presslng^the 
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left (*2*t or tight {*/*} response key to Indicate which word had 

appeared In the text* 

i The target word from the experimental texts always appeared 

as the lefthand word bf the pair* This was to Increase the 

likelihood that subjects were actually reading the target word 

from the experimental texts rather than responding on the basis 

of the dlstracter* Across the whole experiment* th^ correct 

response appeared equally often on the left and. on the right* 

* 

After the subject responded to the tegt words* a feedback 
message was displayed* After one second* the -message was 

m * 

automatically replaced by a verification sentence* Subjects 
Indicated whether or not the sentence was, true of the text by 
pressing one of the two response keys* Again* feedback was 
displayed for one second* % 

Results 

Means were computed as In experiments 1 and 2* Error trials 
were excluded from the analysis* Hean cesponse times and error * 



rates are displayed in Table 6* The a/eans were submitted lo two 

< I 
AWOVAs* m the AHOVA by subjects* Subjects were nested within 

groupr both factors were crossed with text version and distance* 

In the AHOVA by text* target words were nested wl thin text group* 

both factors were crossed with text vefelon and distance* The 

only significant effect was that of distance (Ei<l*23) ■ 5*61* 

£ < *05* HSe » 12712) E 2 (l,20) - 4*92; ft < ,05r HSe - 12185)* - 
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insect Table 6 abnut here 



Although the Means do exhibit the predicted interaction 
pattern* a closer inspection of the data supports the statistical 
analysis. The large Mean response tine In the LoE-Distant cell 
is due to one rather var lable subject who siade two slow responses 
in this condition, if this subject lo excluded Erom the 
analysis* the Mean For the LoE-Dlstant cell drops to 1009 msec.^ 

Discussion 

The lack of an effect ,oF text version or oF an ^Interact ion 
between text version and distance suggests that the target 
argument was no more available at the probe point For the Hi E * 
texts than For the LoE. These Findings provide no support For 
the claim that subjects were Corning spec! Flc predictions as they 
read the 11 1 B texts. 

The Finding oF a significant distance effect Indicates that 
the Forced-choice task was sensitive enough to detect differences 
in the time needed to access the text representation. This 
Finding Is consistent with the results #f leading time studies 
which suggest that antecedent search time varies with the 
distance oF the antecedent. 

There are several possible accounts oF the dot a* Perhaps 
the least Interesting would be an account which claims that 
subjects were Forming specific predictions all OF the time and 
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were equally likely to hove Formed the correct prediction {i.e.* 
Involving the target word) For both the 11 1 B and LoE texts. The 
results of the^ rating task render this account unlikely, in that 
task subjects were much more likely to use the target noun In a 
predicti&n for the 111 E text versions than For the LoE versions, 

A second possibility is that subjects did not have enough 
tine to Form a specific prediction. The processing hypothesised 
for generating a specific prediction included the process oF 
retrieving the specific argument From the text. As the data 
suggest this Is * time-consuming process In the distant , 
condition* It may be that predictive activities are Initiated at 
the end oF the sentence as the subject presses the *^y to go on 
to the next sentence. As a result, when the Forced-choice probe 
lo presented* the specific prediction has not yet been Formed. 
Analyses In Experiments land 2 Found no differences in time 

c 

spent reading the Hie vs. Lofi texts themselves. This result 
supports the claim that readers were not taking tlie extra time to 
generate a specific prediction before going on to the next 
sentence. 

An objection can be raised to the claim that readers 
generate a spec 1 flc predict ion as they move on to the next 
sentence. Time to make a prediction can be expected to vary From 
text to text, depending In part on how obvious the prediction is. 
Thus* for each subject the mean response time For the 11 IE probes 
should be a mix oF trials on which the*mrgument had been 
retrieved to Form the speclFic prediction and trials on which It 
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L * 

fiad not been retrieved before the probe wan presented. Thle 
Interpretation still predict* that the Hie Means should have been 
faster than the LoE. The data do not support this prediction. 

It io clear fro* the ranting task that readers can for* the 
specific predictions elicited by the HIE texts when given 
unlimited, time and when Instructed to generate a prediction. Yet 
It Is also clear from the forced-choice data' that In the courae 
of the reading task, subjects were not generating such specific 
predictions before going on to read the next sentence. It Is 
certainly possible that If the forced-choice probe had been 
delayed by several secQnds, evidence of the presence -ot specific 
predictions might have been discovered. But If specific 
predictions are so time-consuming to generate^ then It Is 
unlikely that such prediction could have played a role In 'the 
first two experiments. In those experiments the sentence which 
fulfilled the prediction appeared Immediately after the sentence 
which elicited the prediction* The effects In those experiments 
would therefore seem likely to reflect the Influence of general 
expectations rather than highly specified predictions* 

The lack of any evidence that readers regularly form highly 
specific predictions suggests that the usefulness of expectations 
Is not limited to highly predictable texts* Host narratives are 
not so transparent that the reader can predict exactly what vlll 
happen next. The results suggest that general expectations may 
be useful In reading a broad range o£ narratlve&r unpredictable 
as well as predictable. 
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General Discussion 

The three erperlments reported here were designed to examine 
the role of expectations In sentence Integration. In the first 
two experiments^ subjects were faster both to read and to judge 
an expectatlon-tolf lllliig target sentence when It followed the 
appropriate HIE text veralon than when It followed the l*oE. 
Subjects were also faster to judge a target sentence to be 
unrelated when lt followed a HIE text* They were alower to read 
a related target sentence which violated the expectation when the 
sentence followed a DIE text, in the third experiment* aubjects 
were no faster to respond to a target word which folJWed a tllE 
tert than when It followed a Lott even though the target word was 
part 1 of the specific prediction elicited by the HIE text In a 
separate rating task*. 

The results of these experiments provide support for an 

T 

expectation model of' the (Allowing sort* Readers regularly' 
generate expectations, about upcoming events as they read 
narratives* These^ expectations consist of s special subset of 
the text propositions which the reader ha* tagged as likely to be 
followed up by the writer; and'posslbly some general causes 
and/or consequences for the tagged Information, activated In long 
term Wmory* -these expectations are not generated for every , 
sentence In every text! they are generated for those sentences 
which are perceived to be causally important to the narrative. 
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Thus* At snme points in a test renders nay have strong 
expectations about upcoming events* and nt other points they may 
have none. Having $n expectation about an Immediately upcoming 
event has consequences Eor the Integration oE upcoming sentences, 
phen an expectation is present* readers try to relate the next 
sentence to the contents oE the expectation. When no expectation 
is presents readers may have to search \ he prior text for related 
information, A correct expectation helps the integration process 
by allowing the reader to bypass some search. An incorrect 
expectation interferes by postponing a necessary search process* 

. Once an expectation 1b formed* It seems to s be given priority 
in the search for causai links. This raises the question of what 
mechanism might be proposed to confer this priority status on the 
subset of text information which is tagged in the expectation* 
In current models a limited-rapacity wording memory Is used to 
give priority to a subset of the text Information (Klntech t van 
Dljk* 197Br Lesgold et al# 1979). The assumption is that the 
contents of working memory are searched first for links to the ** 
curr enL sentence. The search joes beyond working memory only 
when the search for links to information In working memory fails. 
Jt might seem reasonable* then* to claim than an expectation la 
always maintained in working memory* and thus haa priority In the 
search. 

The working, memory account* however* has difficulty with the 
Unrelated results In Experiment 1* Even in the absence of an 
expectation* working memory Is assumed to contain a subset of * 
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text Information. If subjects are fast in the TliE-UnrelatAS 
condition because they are simply checking the Unrelated target 
against the contents of working memory (where the expectation 
resides)* then they should be equally fast in responding to the 
LoE~Unr elated coalition. 

An alternative might be to hypothesize that the reader Is 
arranging the pieces of the causal chain of the story in a 
separate workspace (Olson* Duffy i Hack* in press)* 'Elements in 

the causal chain are thus given special status apart from the 

♦ 

statue given to recent propositions currently residing In working 
memory* Such a claim is embodied In the concept of the macro- 
structure which la constructed during reading In the Klntech and 
van Dljk (1970) model and In the 'weird Hat* In the model of 
Schank and Abel ft on (1977). In both cases a subset of all the 
information presented la identified as useful for understanding 
the causal backbone of the narrative* When* the reader forms an 
expectation about immediately upcoming events, one outcome may be 
the allocation of processing priority to the parts of the causal 
chain Involved In the expectation* This results In a commitment 
to spend time trying to link the next sentence to the pr lor i tized 
propositions* Such a commitment can account for the Unrelated 
results noted above* In the fllg-Unr elated condition* readers 
have identified some text information as part of the causal chain 
and as likely to be followed up. This Information Is placed In 
the workspace and Is used to make s judgment about the Unrelated 
target sentence* In the LoE-Unrelated condition* Jthe reader has 
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not placed causal chain Information In the workspace. The 
judgment of the target sentence thi» requi res ^"search of the 
whole text rather than a search ot the subset ot Information In 
the workspace. 

Conclusion 1 
One major goal ot research on reading comprehension has been 
to characterize the search and Inference processes Involved In 
Integrating the current sentence with the teat propositions which 
have already been read. Processing Is optimized to the extent 
that the reader can focus the Integration attempt on the relevant 
subset of the prior text propoal t lone* In current models working 
memory Is used to give priority In antecedent search t«r a recent 
subset of the already-read text propositions. The experiments 
reported here suggest that expectations are another way that 
readers confer priority on relevant prior text Information, 
Information which Vlll be especially useful for causal 
Inferencing. 
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iThe same pattern of teaults was obtained In the pilot experiment 
using the single word piobe task instead of « foiced'chotcc task. 
Subjects were always probed with the target argument for the 
eiperlmental teitsl their task was to indicate whether the word 
had appealed In the tcit. Mean response times tor 13 subjects 
were (with error percentages In parentheses)) 994 (6.4) In the 
Ills-Close condition! 1057 (12.8) in the HlE-Dlstantf 979 (6.4) In 
the LoE-Closei and 1034 (11.5) In the LoE-Dlstant. 
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Table 1 

h Example Text Versiona fro» Experiment 1 

aiab ExEffjLtftiioD Versiprn ^ 

John was eating hie first neal ever In the dining car of a 
train. 

The waiter brought hi* a large bowl of bean soup. 
John tasted the hot soup carefully. 
Suddenly the train screeched to a atop* 

John wan eating hie firat peal ever in the dining car of a 
train. 

The waiter brought hi* a large bowl of bean aoup. 

John tasted the hot aoup carefully* 

The train began to alow down entering a station. 

TARGET SENTENCES FOR DOT1I VERSlOBSt 

Related; The hot aoup spilled into John's lap. 

unrelated; That night the whole foreat burned down* 
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Table 2 

Mean Response Tines (in msec) snd Percent Disagreement 
for the Target Sentencea in Eiperiaent 1 

Teit Veraion 

Target Sentence niE Lot 

Related 1S88 (2) 2044 (13) 

' Unrelated 1799 (?) 1926 <S> 

Hftfcftt Disagreement percent* are in parentheses. 
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Table 3 

Ettasrple Test Versions from Eitperisient 2 

High ctp ectfttioQ ttet&jjuii 

' John was eating his first steal ever in the dining car of a 
train. 

The waiter brought him a large bowl of bean *joup* 
John tasted the hot soup carefully* 
He reached for the salt shaker* 
Suddenly the train screeched to a stop. 

Lfitf Ex pectation Version! 

John was eating his first steal ever in the dining car of a 
.train* » 

The waiter brought him a large bowl of bean soup* 

John tasted the hot soup carefully* 

He reached for the **lt shaker. 

The train slowed down entering a station*- 

TARGET SENTENCES FOR BOTH VERSIONS. 

Espectedt The soup spilled all over John's clean shirt and 

pants* 

His paper napkin was no help. 

Unettpectedt The waiter cas* to offer John soae coffee* 
John said would like tea with creasu 
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Table 4 

Hean Response Tines tin *sec) for Target 
Sentences in Eitperiatent 2 



Test Version 
IfiE LoE 
TARGET SENTENCE * 

Target E«p 1543 1711 

Sentence 

Type Unes 1879 15*3 

SECONDARY TARGET SENTENCE 

Target Bip 1406 1425 

Sentence A 

Type Unex 14*7 131 h 
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Table 5 

tixample Text Vetslons from Experiment 3 

tljjgb EseeittalJUm - Ci^ifi 

John was eating his first meal ever In the dining car of a 
train. 

The waiter brought hi* a large bowl of bean BOup. 
John tasted the hot soup carefully* 
He reached for the salt shaker* 
Suddenly^the train screeched to a stop* 

Jbctf £ftPe££aLL0D - CJ&sjt 

John was eating his first meal ever In the dining <tar of a 
train. 

The waiter brought him a large bowl of bean soup. 

John tasted the hot soup carefully. 

lie reached for the salt shaker. 

The train slowed down entering a station. 

High EKt^Ati&n z DlBliini 

John was eating his first meal ever In the dining car of a 
train. 

The waiter brought hi* a large bowl of bean soup. 

John tasted the hot soup catefully. 

He reached for the salt shaker* 

tt seemed to be made of sterling Oliver. 
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The railroad's Inltlalo were engraved on one side. 
Suddenly the train screeched to a stop. 

LttK Expectation - fiifitflUt 

John was aafalng his first meal ever In the dining, car of a 

train* * 

The waiter brought him a large bowjl of bean soup. , 

John tasted the hot soup carefully. 

He reached for the salt shaker. 

It seemed to be »*de of sterling sliver. 

Tha railroad's Initials were engrsved on one side 

The train slowad down entering s Station* 

TARGET HOBD FOR ALL VERSIONS t Soup 
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Table 6 

Mean Response Times (in msec) and Percent error 
for experiment 3 

Text Version 
BIB Loe 
Close 960 (1,4) 972 (0,7) 

Distance 

Distant 1009 (0,7) 1033 (0,7) 

Hpfcei Error percents are in parentheses. 
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